5 ms·
LLM is a compiler, not a runtime
- vanjazdr 5mo agoWorking with Anton on the implementation side. The biggest unlock wasn't cost, imo it was swapping mysterious non-reproducible inference bugs for boring, reproducible compiler bugs. The emotional shift of "I can actually debug this" came before the cost savings did.