5 ms·
I think part of the problem is the context windows for humans are actually much smaller than what an LLM can keep track of today. The small context window of hu
by arkmm 2mo ago
I think part of the problem is the context windows for humans are actually much smaller than what an LLM can keep track of today. The small context window of humans is a feature that forces modularity and abstraction in software engineering so that you can decompose what you're working on into something that can fit into your head. But since LLMs can fit so much more in their head, so to speak, they don't have this same incentive, and you get the unorganized mess of spaghetti code that current agents often produce.
- hahahaa 2mo agoAlso a human has to explain the code. There is a social contract and producing slop gets you fired. Especially as you produce it much slower than an LLM.
- arkmm 2mo agoAnd the human has to explain it at 2 tokens/sec (average speaking speed ~130-150 wpm). That's another constraint against slop - humans need to be able to explain their code succinctly.