fxnn

6 ms·

1.
by fxnn 7mo ago
We can expect the model landscape to consolidate some day. Progress will become slower, innovations will become smaller. Not tomorrow, not next year, but the time will come. And then it'll increasingly make sense to build such a chip i
2.
by fxnn 7mo ago
Read the blog post. It mentions that their chip has a small SRAM which can store LoRA.
3.
by fxnn 1y ago
No, it did not mostly refer to to-do lists. At least that's not what I understood. It was an example, yes. But he also referred to Luhmann’s Zettelkasten, a huge collection of notes, systematically interconnected, see https:/&#x2
4.
by fxnn 1y ago
That's one thing where I love Golang. I just tell Aider to `/run go doc github.com/some/package`, and it includes the full signatures in the chat history. It's true: often enough AI struggles to use libraries, and d
5.
by fxnn 1y ago
The author would be excited to learn that CouchDB solves this problem since 20 years. The use case the article describes is exactly the idea behind CouchDB: a database that is at the same time the server, and that's made to be synced w
6.
by fxnn 2y ago
Even if I don’t care much about the „digital garden“ concept, I was much surprised to visit a page called „blogscroll“, click on a link, and then not find a blog.
7.
by fxnn 2y ago
> When we talk about understanding a simple axiomatic system, understanding means exactly that the entirety of the axioms are modeled and applied correctly 100% of the time. Yes, but then, when we talk about understanding in LLMs, we tal
8.
by fxnn 2y ago
Maybe it needs even smaller steps, and a programmatic (i.e. multi prompt) habit to always double-check / validate the assumptions and outcomes.
9.
by fxnn 3y ago
But that also exists in the AI world. It’s called „fine tuning“: a LLM trained on a big general dataset can learn special knowledge with little effort. I’d guess it’s exactly the same with humans: a human that received good general educatio
10.
by fxnn 3y ago
Hmm. You sure this is the same thing? I would say it’s more about confidentiality than about value. Because what companies want to hide are usually secrets, that are available to (nearly) no one outside of the company. It’s about preventing
11.
by fxnn 3y ago
Okay if it’s about looking at one painting and fake that. However, if you train your model on billions of paintings and create arbitrary new ones from that, it’s just a statistical analysis on what paintings in general are made of. The impo
12.
by fxnn 3y ago
Okay, so the scale at which they sale their service is a good argument that this is different from a human learning. However, on the other hand we also have the scale at which they learn, which kind of makes every individual source line of
13.
by fxnn 3y ago
For me that discussion is always hard to grasp. When a human would learn coding autodidacticly by reading source code, and later they would write new code — then they could only do so because they read licensed code. No one would ask for th
14.
by fxnn 3y ago
Sounds like the perspective of someone who never gave that tool a real chance. To me it’s primarily just another aid like IDE inspections, IDE autocompletions etc. I use GitHub Autopilot mainly for smaller chunks of code, another kind of au
15.
by fxnn 4y ago
Highly recommending Martin Kleppmanns „Designing Data-Intensive Applications“ book (O‘Reilly). Covers virtually any topic around database implementation. Well written, big source of knowledge. Introduces concepts gradually and with many exa