4 ms·
Although, tbf, some libraries are documented better than others. Also, local llms with an agentic tool can be a lot of fun to quickly prototype things. Quality
by ryang2718 2y ago
Although, tbf, some libraries are documented better than others.
Also, local llms with an agentic tool can be a lot of fun to quickly prototype things. Quality can be hit or miss.
Hopefully the work trickles down to local models long-term.
- guappa 2y agoAnd you think an llm can generate code to use an undocumented library? :D
- andsoitis 2y agoIf there are open source projects that use said library, then probably yes.
- guappa 2y agoUnless they are not hosted on github, then no :D
- 3D30497420 2y agoEven documented libraries can be a struggle, especially if they are not particularly popular. I'm doing a project with WiFi/LoRa/MQTT on an ESP32. The WiFi code was fairly decent, but the MQTT and especially LoRa library code was nearly useless.
- TeMPOraL 2y agoOf course, why wouldn't it? It's a generative model, not a lookup table. Show it the library headers, and it'll give you decent results. Obviously, if the library or code using it weren't part of the training data, and you don't supply either in the context of your request, then it won't generate valid code for it. But that's not LLM's fault.
- dartos 2y ago> not a lookup table You can imagine the classic attention mechanism as a lookup table, actually. Transformers are layers and layers and layers of lookup tables.
- kvgr 2y agoSonnet 3.5 fails to generate basic JetpackCompose libraries properties properly. Maybe if somebody tried really hard to scrape all the documentation and force feed it, then it could work. But i don't if there are examples of this. Like general LLM, but with complete Android/Kotlin pushed into it to fix the synapses.