6 ms·
> My model doesn't need to know a single line of python. If I had to guess, the weights necessary to encode "how to program" are much larger than the final ste
by pton_xd 1mo ago
> My model doesn't need to know a single line of python.
If I had to guess, the weights necessary to encode "how to program" are much larger than the final step of "output python."
- echelon 1mo agoBut the understanding of the language library ecosystem, or even better, your codebase, could let it execute faster and with less context usage.
- exe34 1mo agoThat's the bit I feel you can do with ragging - keep a large library of well described solutions and then find what you need from it at runtime.
- mathisfun123 1mo ago<THAT'S A BINGO> ie what everyone asking for this fails to immediately realize.
- card_zero 1mo agoYou're a bingo. It's obvious that a model could know no Python, since Python could not exist in the world in the first place.
- kennywinker 1mo agothe best llm for coding is the one that knows every programming language imagined by a caffeine-fuelled comp-sci student at 2am but never built.
- Retro_Dev 1mo agoif neuralink ever becomes a thing, thoughts about programming might be stolen for LLM training data lol
- mohamedkoubaa 1mo agoSure but I bet this doesn't translate as well in this way to things like Erlang