5 ms·
NVidia has reasonable incentives to keep things open indefinitely, it wants people to use it's GPUs
by make3 21d ago
NVidia has reasonable incentives to keep things open indefinitely, it wants people to use it's GPUs
- noosphr 21d agoIssue is that llama.cpp is the best way to run models on hardware that isn't nvidias.
- alightsoul 21d agoExcept when they have less than 16 gb of ram?
- dannyw 21d agoA lot of llama.cpp contributions come from the community and ecosystem, like Unsloth. If something goes awry, I fully expect lots of forks.
- MrDrMcCoy 20d agoThere already are a lot of forks for things they decline to implement. TurboQuant, ROCmFPX, and more. I need to set up an agent that will loop on merging them.
- swozey 21d agoIt'd be really nice if I could use my egpu 4090 on my macbook pro..
- richrichardsson 21d agoFor LLM workloads this might help? https://docs.tinygrad.org/tinygpu/ https://docs.tinygrad.org/tinygpu/
- swozey 21d agoInteresting, I've never seen this, thanks
- well_ackshually 21d agoNvidia is halving the production of its higher end GPUs, doubling prices and heavily segmenting the market. They don't give a single shit about individuals. One wafer that makes 10 5090s that might sell at 3000 each, or one wafer that it already sold 6 months ago for 200k to one of the incestuous AI companies it works with?