nimski

5 ms·

1.
by nimski 19d ago
Yes, although the folks that said "this is the worst it will ever be" have some evidence in their court. The best models now are much better than the best models a year ago. Some big gnarly problems remain (e.g. continual learning
2.
by nimski 19d ago
Because I'm guessing your passion was for the craft and not just the result. Before there were factories, if you wanted a chair you needed an artisan to make one for you. When factories pumped out chairs, there was no need for the arti
3.
Why aren't there more AlphaFolds?(nkeivan.com)
4 points by nimski 3mo ago|0 comments
4.
by nimski 8mo ago
nkeivan.com
5.
by nimski 8mo ago
bravo
6.
by nimski 2y ago
This has been the thesis behind our product since the beginning (~3 years), before a lot of the current hype took hold. I'm excited to see it gain more recognition. Chat is single threaded and ephemeral. Documents are versioned, multi-
7.
by nimski 3y ago
Karpathy recently tweeted about the importance of being close to the data when training LLMs, and I think a similar level of rigor and transparency is essential when judging evaluations. Thanks for bringing us this insight from the data.
8.
by nimski 3y ago
Building hierarchical abstractions on top of code is IMO the only way to truly enable AI to write code beyond better autocomplete. Kevin's work with DreamCoder shows that hierarchical abstractions can be built automatically in the code
9.
by nimski 3y ago
This is what we're doing. I think it's not only possible, but also necessary for applications beyond trial-and-error generation.
10.
by nimski 3y ago
Is that really that much of a barrier? Off the top of my head: you could start with a prompt like "write a summary of book XYZ, followed by a summary of each chapter". Then dive deeper into each one from there using the same promp
11.
by nimski 3y ago
I appreciate the example, but here's where I think it differs as an analogy of what LLMs do: A summary doesn't have infinite or variable depth. If you read the summary of a non-fiction (I'll limit my argument to that, as anot
12.
by nimski 3y ago
You're right. I think it's fair to carve out fiction from my argument. For that, I would surely go to the source material until the point where the LLM was coming up with better long-form fiction de-novo. But for non-fiction, whic
13.
by nimski 3y ago
"The difference, when it comes to AI, is one of scale. ChatGPT can “read” more published words in a few seconds than I could in several lifetimes and, unlike me, that data isn’t immediately replaced in my human-limited short-term memor
14.
by nimski 3y ago
The addition of many remote positions since COVID has been a great hiring filter for us. For the type of work we do (AI, R&D), and the culture that we find most productive and enjoyable (enthusiasm because we love the work, a sense of w
15.
by nimski 6y ago
It is possible to build technical solutions that take the work and luck out of social organization by shouldering the heavy lifting, but then get out of the way once people meet IRL. The best tool for this right now is calendar and email. T