dsemakin

6 ms·

1. 1.▲
   by dsemakin 9d ago

   You got me interested, a rough table of model size to instance type to spot $/hr would help a lot. The 0.5B example is CPU only, so it doesn't say much about what a 7B or 70B actually costs.
2. 2.▲
   by dsemakin 11d ago

   What triggers a memory getting written in practice? is it on me to remember engrim add?
3. 3.▲
   by dsemakin 11d ago

   Nice concept, the offline provisioning is the part that stands out to me vs Tailscale. How does revocation work in that model? Didn't see it in the docs, if a laptop with a .peer profile gets stolen, what then?
4. 4.▲
   by dsemakin 12d ago

   Just at the right time, will be trying this out. I see it as an addition to local LLM, where on a job cycle it can learn from the LLMs contexts and free it up and help it in the more complex work.
5. 5.▲
   by dsemakin 19d ago

   Would be really cool to see two things. First some kind of before and after benchmark, so you can actually see if defragging made a difference. Second is a recommendation for defragging based on things like the fragmentation, free space, an
6. 6.▲
   by dsemakin 20d ago

   Does it work also on multi modal LLMs?
7. 7.▲
   by dsemakin 21d ago

   Interesting concept, I really like the idea of monitoring the domain. I tried 1 domain I am looking at: bein.com, resulted in a thousand domains and not this one. Will give it a better look though.