ryan_glass

17 ms·

1.
by ryan_glass 8d ago
This reminds me of a certain Southpark episode...
2.
by ryan_glass 11d ago
I would not buy a car with carplay. I don't want any tech in my car.
3.
by ryan_glass 13d ago
Any recommendations for a FOSS alternative?
4.
by ryan_glass 23d ago
It seems very expensive. I built a 5m x 3m 'log cabin' garden office (in Scotland in 2018), with electricity and cat6 cabled internet for £5k (approx $6800). The shed itself was a kit-build so easy and for foundations I used stake
5.
by ryan_glass 1mo ago
I'm amazed that people are still on Facebook in 2026. Deleted my account after the Cambridge Analytica scandal. There really is nothing I miss.
6.
by ryan_glass 1mo ago
Ollama uses the llama.cpp backend for inference. I find Ollama noticably slower. Llama.cpp has had a built-in webui (used as llama-server) for a long time now so have owned the user experience too.
7.
by ryan_glass 3mo ago
I'm sure this is a wonderful breaktheough but I'd rather have the current, or a recent, generation of semiconductor technology available at a reasonable price.
8.
by ryan_glass 3mo ago
For a fraction of the price of 96GB vram, I built a desktop based on a supermicro server mobo and EPYC 9 series CPU, with just under 400GB rdimm ram (approx $4500 all in but this was before the ram price hike). Works really well for serving
9.
by ryan_glass 3mo ago
"Make the button red" probably doesn't need an LLM at all.
10.
by ryan_glass 1y ago
Coding, my own proprietary code hence my desire for local hosting, a decent amount of legacy code. General troubleshooting of anything and everything from running Linux servers to fixing my car. Summarizing and translation of large document
11.
by ryan_glass 1y ago
Basically it comes down to memory bandwidth of server CPUs being decent. A bit of oversimplification here but... The model and context have to be pulled through RAM (or VRAM) every time a new token is generated. CPUs that are designed for s
12.
by ryan_glass 1y ago
To be honest I haven't used o3 or Sonnet as the code I work with is my own proprietary code which I like to keep private, which is one reason for the local setup. For troubleshooting day to day things I have found it at least as good a
13.
by ryan_glass 1y ago
The quality on Gemma 27B is nowhere near good enough for my needs. None of the smaller models are.
14.
by ryan_glass 1y ago
It might be 5 to 10 times slower than a hosted provider but that doesn't really matter when the output is still faster than a person can read. Context wise, for troubleshooting I have never needed over 16k and for the rare occasion whe
15.
by ryan_glass 1y ago
Thank you for making the dynamic quantisations! My setup wouldn't be possible without them and for my personal use, they do exactly what I need and are indeed excellent.
16.
by ryan_glass 1y ago
No hard numbers I'm afraid in that I don't monitor the power draw. But the machine uses a standard ATX power supply: a Corsair RM750e 750W PSU and the default TDP of the CPU is 280W - I have my TDP set at 300W. It is basically bui
17.
by ryan_glass 1y ago
You are right that I haven't been rigorous - it's easy to benchmark tokens/second but quality of output is more difficult to nail down. I couldn't find any decent comparisons for Unsloth either. So I just tried a few of
18.
by ryan_glass 1y ago
Prompt eval time varies a lot with context but it feels real-time for short prompts - approx 20 tokens per second but I haven't done much benchmarking of this. When there is a lot of re-prompting in a long back and forth it is still qu
19.
by ryan_glass 1y ago
I run Deepseek V3 locally as my daily driver and I find it affordable, fast and effective. The article assumes GPU which in my opinion is not the best way to serve large models like this locally. I run a mid-range EPYC 9004 series based hom
20.
The effect of Covid-19 lockdowns on website downtime globally(downtimemonkey.com)
1 points by ryan_glass 6y ago|0 comments
21.
by ryan_glass 6y ago
Great idea - I can see this being popular. Small heads-up on responsiveness needing fixed on tablet in portrait view.
22.
by ryan_glass 6y ago
It would be interesting to see graphs of deaths for other reasons to compare numbers. For example deaths from starvation/malnutrition are likely increasing in India due to lockdown ( https://www.theguardian.com/world&#x2
23.
by ryan_glass 7y ago
Scotland has a right of access to land (including beaches) as well as inland water throughout the country. This is known as 'the right to roam' and is a good example of a jurisdiction where statutory right of access works well: h
24.
by ryan_glass 7y ago
This article really, really makes me want to give Go a shot - more than anything I've read about the language before.
25.
by ryan_glass 7y ago
One possible issue with this article is that its focus is on students - their 'job' being to learn as opposed to producing or delivering something, which is the aim once their skills are learned. Learning is often done best in sma
26.
by ryan_glass 7y ago
Nice post - thanks. I'm guilty of sometimes splitting and other times not, making the choice mostly on feel. Never modifying local state when splitting functions is an easy rule of thumb to follow.