samwho

6 ms·

1. 1.▲
   Domains by the Numbers(dotcom.press)

   3 points by samwho 2mo ago|0 comments
2. 2.▲
   by samwho 2mo ago

   You are extremely welcome.
3. 3.▲
   by samwho 2mo ago

   Sam Rose here. Thank you <3
4. 4.▲
   by samwho 3mo ago

   I gave my boss every opportunity to stop me.
5. 5.▲
   by samwho 3mo ago

   Single browser.
6. 6.▲
   by samwho 3mo ago

   I learned that etcd wasn’t required while making webernetes! I’d always thought it was, was cool to learn some clusters use other storage backends.
7. 7.▲
   by samwho 3mo ago

   Completely agree! Wasn’t trying to discourage, hope it doesn’t have that effect.
8. 8.▲
   by samwho 3mo ago

   Thank you! To address the earlier comment: I didn’t go down the “implement the OS-level stuff required to get k8s to compile to wasm” path due to bundle size, honestly and truly. My testing indicated it could be over 10Mb, and I didn’t want
9. 9.▲
   by samwho 3mo ago

   I’d guess that about 90% of the webernetes code is ported directly from the Kubernetes codebase. In that sense it is a port of Kubernetes to the browser. But the CRI and CNI are facsimiles created to work in the browser and for the purpose
10. 10.▲
    by samwho 3mo ago

    I’m 100% confident it would be possible to do a worker-per-pod runtime. If you’re serious about trying to make it then slide into my DMs, would love to talk about it. I also think a CRI that supports WASM would be fairly easy. Volumes are o
11. 11.▲
    by samwho 3mo ago

    This is it. If you’re building something novel, and you want to rely on LLMs, you need to invest heavily in making tests. You don’t have the luxury of a reference implementation like I did here.
12. 12.▲
    by samwho 3mo ago

    I have some potentially bad news for you: https://samwho.dev/load-balancing https://encore.dev/blog/queueing
13. 13.▲
    by samwho 3mo ago

    For some projects I think only reading the tests is probably fine. In this project I didn’t think it was enough purely because it’s a port of existing code, so there was a need to validate the port was as exact as it could be. Many projects
14. 14.▲
    by samwho 3mo ago

    Web workers were on my mind from the start but I never found myself needing them. They were always my ace-in-the-hole if this ended up being too CPU hungry on the main thread but it never happened, so I didn’t bother. One of the fun things
15. 15.▲
    by samwho 3mo ago

    Sadly Katacoda got paywalled (totally get why they did it, these things have costs). I think some other similar platforms disappeared because they ran out of people willing to fund it. It’s a shame. I’m hoping this offers an alternative. It
16. 16.▲
    by samwho 4mo ago

    Looking really good! Great work.
17. 17.▲
    by samwho 6mo ago

    You’re welcome! Thanks so much for the kind words.
18. 18.▲
    by samwho 6mo ago

    Thank you!
19. 19.▲
    by samwho 6mo ago

    “Zero point” is how I saw it referred to in the literature, so that’s what I went with. I personally prefer to think of it as an offset, but I try to stick with terms folks are likely to see in the wild.
20. 20.▲
    by samwho 6mo ago

    Definitely could be, but in the time I spent talking to the 4-bit models in comparison to the 16-bit original it seemed surprisingly capable still. I do recommend benchmarking quantized models at the specific tasks you care about.
21. 21.▲
    by samwho 6mo ago

    Thank you! I was really surprised how robust models are to losing information. It seems wrong that they can be compressed so much and still function at all, never mind function quite closely to the original size. Think we're only going
22. 22.▲
    Quantization from the Ground Up(ngrok.com)

    351 points by samwho 6mo ago|59 comments
23. 23.▲
    Don't blunder: better chess puzzles(blunder.clinic)

    3 points by samwho 6mo ago|2 comments
24. 24.▲
    by samwho 6mo ago

    Thanks for linking to my silly little quiz in the article! :)
25. 25.▲
    by samwho 7mo ago

    I wrote a tool called llmwalk ( https://github.com/samwho/llmwalk ) that’ll deterministically show you the likelihood the top N answers are for a given open model and prompt. No help on frontier models, but maybe helpful
26. 26.▲
    Calculating the shortest path using just CSS(css-tip.com)

    1 points by samwho 7mo ago|0 comments
27. 27.▲
    What those AI benchmark numbers mean(ngrok.com)

    5 points by samwho 8mo ago|1 comments
28. 28.▲
    by samwho 8mo ago

    My mistake! Misunderstood the underlying dataset. Not sure how to edit it though. Thanks for calling it out.
29. 29.▲
    Graph of All Human Languages(dr.eamer.dev)

    4 points by samwho 8mo ago|2 comments
30. 30.▲
    by samwho 8mo ago

    Oh, you beat me to it! :D