antoine-levitt

6 ms·

1.
by antoine-levitt 9mo ago
Could you share a bit more details on your config?
2.
by antoine-levitt 11mo ago
You can easily test a gradient using only the forward pass by doing f(x+h) ~ f(x) + dot(g, h) for a random h
3.
by antoine-levitt 2y ago
Very fun! It would be interesting to do this with actual quantum mechanics (ie solving the schrodinger equation for an inverted quadratic potential). The usual bound states of the harmonic oscillator can be analytically continued into reson
4.
by antoine-levitt 2y ago
I just skimmed the article and didn't watch the video, but the bit about backpropagation is just wrong. Backpropagation doesn't compute an inverse of the jacobian, it computes its transpose. (although a similar idea to backpropaga
5.
by antoine-levitt 2y ago
I'm willing to bet the actual reason the transition went so smoothly and the library doesn't pay that much in per-article fees is because everybody just used sci-hub.
6.
by antoine-levitt 3y ago
> The name quantum in quantum theory is related to the fact that in a separable Hilbert space, any set of mutually orthonormal vectors is countable. Pretty sure the name quantum comes from the fact that some physical phenomena (eg absorp
7.
by antoine-levitt 4y ago
(in mice)
8.
by antoine-levitt 5y ago
... And so that constraint forces R1 to be zero? Note that finding a solution to the problem originally stated is equivalent to a linear programming problem, which (for such a simple problem) can easily be solved exactly.
9.
by antoine-levitt 5y ago
Do not be fooled, julia is not a oo language, despite some similarities. If you try to replicate oo patterns in Julia it's not going to work well, but in idiomatic julia I've never found the need for concrete subtyping: generally
10.
by antoine-levitt 5y ago
MPI.jl does not have an array wrapper type, it just exposes the bare mpi calls. Some other packages do use it to build array types.
11.
by antoine-levitt 5y ago
Are you sure that the difference is due to the allocations? I would expect this to be dominated by matrix multiplies or svds. Are you comparing this with the same blas/LAPACK? Edit : OK, I see those are small matrices. Then Staticarra