justinnk

9 ms·

1.
by justinnk 2mo ago
Not sure whether Karpathy meant it like that or thought about this statement being interpreted this way, but I totally agree with you. Creating animated movies and special effects is placing a lot of 3d polygons by hand. Maybe not with Ja
2.
by justinnk 2mo ago
I agree, this seems like an important discovery. And it hits a sweetspot of being effective and very simple to implement. Have a look at the pseudocode comparison at the bottom of the accompanying github page: https://explorative
3.
by justinnk 2mo ago
I once heard a lecture about „learning how to learn“. There are already a lot of well-researched things one can exploit about the way we process information. What you describe is known as retrieval cue. Our minds seem to be associative^1. I
4.
by justinnk 2mo ago
Exactly. If someone works on bioengineering viruses that could start a global pandemic, they have to ensure a highly secure working environment. Nothing must ever escape the lab unintentionally. It’s basically common sense. Similar standard
5.
by justinnk 4mo ago
Interesting analogy. I believe regarding addictiveness they may be compared. > a shift of skills away from things that mattered more in the past toward other things that are not measured/perceived by the older generation. Do you hav
6.
by justinnk 4mo ago
Totally agree that it requires struggle and I did not say you should use it to just get the solution. What I think one can do is use it more like a personalized textbook which you can ask any question. It can also provide you with problems
7.
by justinnk 4mo ago
I see where you are coming from. However, in the role of personal teachers they may allow especially our young generations to reach a deeper understanding of maths (and also other topics) much quicker than before. If everyone can have a per
8.
by justinnk 6mo ago
They already had a basic form of this for a while [1] > arXiv requires that users be endorsed before submitting their first paper to arXiv or a new category. [1] https://info.arxiv.org/help/endorsement.html
9.
by justinnk 6mo ago
I think it really depends on the how. Engaging with it in a socratic debate-style argument [1] if no fellow human is available might very much support your thought process. On the other hand, just obtaining the solution to one‘s homework&#x
10.
by justinnk 7mo ago
Thank you for the good laugh! This whole thread is peak satire. Although, be careful. It reminds me of the foreword to a shortstory someone shared on HN recently: „[…] Read it and laugh, because it is very funny, and at the moment it is sa
11.
by justinnk 9mo ago
I believe Enzyme comes close to what you describe. It works on the LLVM IR level. https://enzyme.mit.edu
12.
by justinnk 1y ago
What you suggest seems plausible, but there is a very good counter example. Overleaf is also managing well by relying on the open-source LaTEX. What drives people to subscribe is not the typesetting itself, but the ecosystem around it (coll
13.
by justinnk 1y ago
Reminds me a bit of Isaac Asimov‘s novel „I, Robot“ where they rely on positronic brains to do things. In the story, mathematics seems to have caught up and developed a framework to analyse the behavior of an AI system. I wonder if somethin
14.
by justinnk 1y ago
I can second this, even availability of the code is still a problem. However, I would not say CS results are rarely reproducible, at least from the few experineces I had so far, but I heard of problematic cases from others. I guess it also
15.
by justinnk 2y ago
This is very interesting! I think an exciting direction would be to arrive at minimal circuits that are to some extent comprehensible by humans. Now, this might not be possible for every system, but certainly the rules of Conway‘s GoL can
16.
by justinnk 2y ago
You can actually use this to import pdfs generated with Matplotlib as vector graphics into Impress presentations. This allows you to change, e.g., the color of lines or the legend (or any other part of the plot) right within Impress to bett
17.
by justinnk 2y ago
There is also an open-source/free version of this [1], which I use regularly. You can install it, e.g., in Fedora, with the ‚diffpdf’ package. It is no longer maintained but works very well, has a nice GUI with a side-by-side view, dra
18.
by justinnk 2y ago
(I am one of the authors) Generally speaking, the latter. The purpose of DiscoGrad is just to deliver useful gradients. These provide information about the local behavior of the cost function around the currently evaluated point to an optim
19.
by justinnk 2y ago
Thanks! You may find DeepProbLog by Manhaeve et al. interesting, which brings together logic programming, probabilistic programming and gradient descent/neural networks. Also, more generally, I believe in the field of program synthesis
20.
by justinnk 2y ago
You are right in that the use-cases are very similar to regular autodiff, with the added benefit that the returned gradient also accounts for the effects of taking alternative branches. Just to clarify: we do a kind of source-to-source tran
21.
by justinnk 2y ago
(I am one of the authors) Thanks for your question. Yes, similar to what you describe but not quite. The prime use case is to apply DiscoGrad together with a gradient descent optimizer to optimization problems. For a C++ program to be regar