loubbrad

8 ms·

1.
by loubbrad 2mo ago
The author does define these terms implicitly at the beginning of §1, where they define standard MHA in this notation. From the formula, (q_t) is the query generated from the hidden state at the (t)-th position (e.g. the token at position (
2.
Claude Fable produced a counterexample to the Jacobian Conjecture(xcancel.com)
803 points by loubbrad 2mo ago|514 comments
3.
by loubbrad 2mo ago
Context: https://en.wikipedia.org/wiki/Jacobian_conjecture
4.
by loubbrad 8mo ago
> I think there is a section of programmer who actually do like the actual typing of letters, numbers and special characters into a computer... Reminds me of this excerpt from Richard Hamming's book: > Finally, a more complete, a
5.
by loubbrad 11mo ago
Also relevent - https://arxiv.org/pdf/1902.04094
6.
by loubbrad 2y ago
Multi-track transcription has a long way to go before it seriously useful for real-world applications. Ultimately I think that converting audio into MIDI makes a lot more sense for piano/guitar transcription than it does for complex mu
7.
by loubbrad 2y ago
I agree that the audio->score and MIDI->score problems are quite hard. There has been research in this area too, however it is far less developed than audio->MIDI.
8.
by loubbrad 2y ago
Essentially, the leading way to do automatic music transcription is to train a neural network on supervised data, i.e., paired audio-MIDI data. In the case of piano recordings, there is a very good dataset for this task which was released b
9.
by loubbrad 2y ago
I didn't see it referenced directly anywhere in this post. However, for those interested, automatic music transcription (i.e., audio->MIDI) is actually a decently sized subfield of deep learning and music information retrieval. Ther
10.
by loubbrad 3y ago
When I was studying Mathematics I initially thought TDA was magic. I remember seeing MATLAB correctly compute the Homology groups of a Torus from a randomly sampled point cloud. As I veer farther into the CS/ML world I've come to
11.
by loubbrad 3y ago
Leaving this here (not self promo): https://www.youtube.com/watch?v=hZS96dwKvt0 By far the best non-beginner git tutorial I've ever found.