70 lines
3.2 KiB
Markdown
70 lines
3.2 KiB
Markdown
## A.I. Duet
|
|
|
|
A piano that responds to you.
|
|
|
|
## About
|
|
|
|
This experiment lets you make music through machine learning. A neural network was trained on many MIDI examples and it learned about musical concepts, building a map of notes and timings. You just play a few notes, and see how the neural net responds.
|
|
|
|
[https://aiexperiments.withgoogle.com/ai-duet](https://aiexperiments.withgoogle.com/ai-duet)
|
|
|
|
This is not an official Google product.
|
|
|
|
## CREDITS
|
|
|
|
Built by [Yotam Mann](https://github.com/tambien) with friends on the Magenta and Creative Lab teams at Google. It uses [TensorFlow](https://tensorflow.org), [Tone.js](https://github.com/Tonejs/Tone.js) and open-source tools from the [Magenta](https://magenta.tensorflow.org/) project. Check out more at [A.I. Experiments](https://aiexperiments.withgoogle.com).
|
|
|
|
## OVERVIEW
|
|
|
|
A.I. Duet is composed of two parts, the front-end which is in the `static` folder and the back-end which is in the `server` folder. The front-end client creates short MIDI files using the players's input which is sent to a [Flask](http://flask.pocoo.org/) server. The server takes that MIDI input and "continues" it using [Magenta](https://github.com/tensorflow/magenta) and [TensorFlow](https://www.tensorflow.org/) which is then returned back to the client.
|
|
|
|
## DOCKER
|
|
|
|
[Docker](https://www.docker.com/) is an open-source containerization software which simplifies installation across various OSes. It is the simplest method to build and install both the front-end and back-end components. Once you have Docker installed, you can just run:
|
|
|
|
```bash
|
|
$ sudo docker build -t ai-duet .
|
|
$ sudo docker run -t -p 8080:8080 ai-duet
|
|
```
|
|
|
|
You can now play with A.I. Duet at [localhost:8080](http://localhost:8080).
|
|
|
|
## DOCKER-COMPOSE
|
|
|
|
```bash
|
|
$ docker-compose build
|
|
$ docker-compose up -d
|
|
```
|
|
|
|
You can now play with A.I. Duet at [localhost:8080](http://localhost:8080).
|
|
|
|
## MIDI SUPPORT
|
|
|
|
The A.I. Duet supports MIDI keyboard input using [Web Midi API](https://webaudio.github.io/web-midi-api/) and the [WebMIDI](https://github.com/cotejp/webmidi) library.
|
|
|
|
## PIANO KEYBOARD
|
|
|
|
The piano can also be controlled from your computer keyboard thanks to [Audiokeys](https://github.com/kylestetz/AudioKeys). The center row of the keyboard is the white keys.
|
|
|
|
## AUDIO SAMPLES
|
|
|
|
Multisampled piano from [Salamander Grand Piano V3](https://archive.org/details/SalamanderGrandPianoV3) by Alexander Holm ([Creative Commons Attribution 3.0](https://creativecommons.org/licenses/by/3.0/)).
|
|
|
|
String sounds from [MIDI.js Soundfonts](https://github.com/gleitz/midi-js-soundfonts) generated from [FluidR3_GM.sf2](http://www.musescore.org/download/fluid-soundfont.tar.gz) ([Creative Commons Attribution 3.0](https://creativecommons.org/licenses/by/3.0/)).
|
|
|
|
## LICENSE
|
|
|
|
Copyright 2016 Google Inc.
|
|
|
|
Licensed under the Apache License, Version 2.0 (the "License");
|
|
you may not use this file except in compliance with the License.
|
|
You may obtain a copy of the License at
|
|
|
|
http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
Unless required by applicable law or agreed to in writing, software
|
|
distributed under the License is distributed on an "AS IS" BASIS,
|
|
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
See the License for the specific language governing permissions and
|
|
limitations under the License.
|