kennethwolters

7 ms·

1.
Convert Your Chatbot's Markdown to Discord-Complaint Markdown(markdowntodiscord.com)
2 points by kennethwolters 2d ago|0 comments
2.
Litelm: LiteLLM Without the Bloat(github.com)
176 points by kennethwolters 7d ago|63 comments
3.
Litelm: Litellm Without the Bloat(github.com)
1 points by kennethwolters 6mo ago|1 comments
4.
by kennethwolters 6mo ago
First commit was 2 weeks ago. A clean-room rewrite of only the most essential APIs of litellm. Was annoyed that DSPy was about 250 MB big. Mostly due to litellm being bloated and numpy. In order to create dspy-lite [1], I had to create a li
5.
AI 2.0(kennethwolters.com)
3 points by kennethwolters 8mo ago|1 comments
6.
by kennethwolters 8mo ago
Wrote a piece arguing that AI 1.0 is feudal because GPU scarcity concentrated power in a few cloud providers, but the coming GPU glut will invert this dynamic and make open weights + commodity compute the foundation of AI 2.0. The thesis is
7.
by kennethwolters 9mo ago
LLM-driven narrative game. Main technical issue is how go do compaction. I’ve devised a memory hierarchy that compacts the story to a constant amount of tokens per layer. Arc -> Scene -> Moment -> Line. Not sure if that’s the right
8.
by kennethwolters 10mo ago
for me it feels like: Everything is stateful by default/convenience. Building robust systems is in part about confining statefulness to as few parts as possible. To contain statefulness. It’s to buy you some time and capacity. Yet the
9.
AI Under the Hood Part I: Understanding the Machine(kennethwolters.com)
4 points by kennethwolters 1y ago|2 comments
10.
by kennethwolters 1y ago
LLMs are pretty slow. Started a blog post series sharing what I've learned in search of faster LLMs.
11.
No AGI in Sight: What This Means for LLMs(kennethwolters.com)
4 points by kennethwolters 1y ago|1 comments
12.
by kennethwolters 1y ago
Wrote an essay on what LLMs reaching their technological limits could mean to "AI Engineering".
13.
by kennethwolters 2y ago
not an attempt at rebutting or so, just adding my thoughts: It doesn't matter if the product is great because of those values if there is a lack product (bc politics and bureaucracy make it infeasible to produce). Makes you think if th
14.
by kennethwolters 2y ago
Why don't you think that calling the app "Llama-OCR" is good enough?
15.
by kennethwolters 2y ago
can someone tell me what the difference is to the webclient? Seems like a webview to me. No local caching/store.
16.
by kennethwolters 2y ago
Yeah that's a problem. I agree.
17.
by kennethwolters 2y ago
You are responsible for curating your "For You" tab by following/liking-posts-of/replying-to-posts-of/muting/blocking/unfollowing the right accounts. Once I accepted that my "For You" tab got muc
18.
by kennethwolters 2y ago
It is very good at "non-human subjects in photos with shallow focus". Really curious to see what other low-hanging fruits people are finding.
19.
by kennethwolters 2y ago
It is very impressive :)
20.
by kennethwolters 2y ago
txtai is not (just) a vector store, it's a full-fledged RAG system. Apples and oranges if you ask me.
21.
by kennethwolters 2y ago
Don't have anything to add to the others. Just sharing a way of thinking for deciding between RAG and fine-tuning: (A) RAG is for changing content (B) fine-tuning is for changing behaviour (C) see if few shot-learning or prompt enginee
22.
by kennethwolters 2y ago
I am a big fan of local-first design principles. For most enthusiasts, it's the performance benefits. However, for me, it's the potential it has for privacy in web clients. If you have a web client that only does on-client data st
23.
by kennethwolters 2y ago
tuition-free for how long? current class? Forever?
24.
by kennethwolters 2y ago
fair point!
25.
by kennethwolters 2y ago
Thank you, I will have a look :) This YT channel is gem I found: https://www.youtube.com/@SailingTipsCa Doesn't post a lot, not very high production quality but very high quality information.
26.
by kennethwolters 2y ago
I am fascinated by off-shore sailing, competitive and otherwise. How racers manage to do the vendee globe (solo, from france around-the-world back to france) in just 80 days with just sails and ropes as engines is beyond me. FYI the fastest
27.
by kennethwolters 2y ago
Don't forget Kary Mullis as another famous scientist thinking HIV does not cause AIDS. I personally don't know what to make of Mullis' and Duesberg's claims. But I found an interesting Mullis article recently in which he
28.
by kennethwolters 2y ago
This actually looks great. More choices in terms of GitLab hosting pricing models.
29.
by kennethwolters 2y ago
I am looking into renting Hetzner GEX44 dedicated server to run a couple models on with Ollama. I haven't done the arithmetics yet but I wouldn't be surprised to see a 100x cost-decrease compared to OpenAI APIs (granted the models
30.
by kennethwolters 2y ago
IMO petroleum scattering around earth as CO2 damages earth less than petroleum scattering around earth as a petroleum-based solid. Both is bad tho - can't mix layers that are not meant to meet.

More ›