6 ms·
Glad to see people posting links to music modeling projects - it's a huge space, and a ton of fun to actively work on or just mess with if you like music and co
by kastnerkyle 8y ago
Glad to see people posting links to music modeling projects - it's a huge space, and a ton of fun to actively work on or just mess with if you like music and code. Even simple markov models can get someplace with a bit of tweaking [0][1].
If you like this, you might like some more recent work from Anna huang et. al. at Magenta, using a modified Transformer network [2][3].
Some other relevant reading includes DeepBach [4][5], and outside the domain of Bach alone, the venerable folkRNN [6]. There's a huge chain of work I posted a while back here [7], and Kyle McDonald wrote a really great review piece here [8].
Modeling music in latent spaces has also seen a number of recent publications [9][10][11], and having smooth latent spaces for generation seems (to me) to be a very natural interface for manipulating things, which has a natural analogue in "real" composition, cool video at [12].
There have also been some really fun online demos for interacting with these types of systems [13]
There's a lot of interesting work going on in music modeling, hopefully leading to new and interesting musical tools and toys. Interactivity (often via clever conditioning) can really change the way you approach these types of problems [14].
[0] https://github.com/kastnerkyle/magenta/tree/my_cleanup_branch/exp/markov_lm https://github.com/kastnerkyle/magenta/tree/my_cleanup_branc...
[1] https://www.youtube.com/watch?v=Ay8mHW0-NW8&list=PLRMa_gJ8vx8mC9VvtXE7eGamGdf3MxzV4 https://www.youtube.com/watch?v=Ay8mHW0-NW8&list=PLRMa_gJ8vx...
[2] https://twitter.com/kastnerkyle/status/1018617315196309504 https://twitter.com/kastnerkyle/status/1018617315196309504
[3] https://arxiv.org/abs/1809.04281 https://arxiv.org/abs/1809.04281
[4] https://www.flow-machines.com/archives/deepbach-polyphonic-music-generation-bach-chorales/ https://www.flow-machines.com/archives/deepbach-polyphonic-m...
[5] https://github.com/Ghadjeres/DeepBach https://github.com/Ghadjeres/DeepBach
[6] https://github.com/IraKorshunova/folk-rnn https://github.com/IraKorshunova/folk-rnn
[7] https://news.ycombinator.com/item?id=14822281 https://news.ycombinator.com/item?id=14822281
[8] https://medium.com/artists-and-machine-intelligence/neural-nets-for-generating-music-f46dffac21c0 https://medium.com/artists-and-machine-intelligence/neural-n...
[9] https://storage.googleapis.com/magentadata/papers/multitrack/index.html https://storage.googleapis.com/magentadata/papers/multitrack...
[10] https://magenta.tensorflow.org/music-vae https://magenta.tensorflow.org/music-vae
[11] https://www.youtube.com/watch?v=BbyvbO2F7ug https://www.youtube.com/watch?v=BbyvbO2F7ug
[12] https://www.youtube.com/watch?v=A8d-PUuUJnA https://www.youtube.com/watch?v=A8d-PUuUJnA
[13] https://codepen.io/teropa/ https://codepen.io/teropa/
[14] https://twitter.com/chrisdonahuey/status/1051868153700016128 https://twitter.com/chrisdonahuey/status/1051868153700016128