9 ms·
Seeing a lot of these “run 1TB models with 1GB RAM” projects recently. Most seem vibe coded and probably won’t be maintained. Hoping a winner emerges with some
by roger_ 2mo ago
Seeing a lot of these “run 1TB models with 1GB RAM” projects recently. Most seem vibe coded and probably won’t be maintained.
Hoping a winner emerges with some real momentum behind it.
- hiramwen 2mo agoYou don't really need a maintainer when codex or claude code can set it up for you; thats how I got Trellis2 working on windows and tiny VRAM despite Microsoft recommending you have 24GB VRAM and Linux. Models are pretty disposable now.
- titularcomment 2mo agoThis is complete dependency on LLM tools all the way from development to usage, and is risky as well as prone to failure
- hiramwen 2mo agoLocal inference without access to internet and tools is pretty safe, worst you get is a slop output, best case it solves your prompt.
- tecleandor 2mo agoSo, instead of having one or two maintained projects that work super well, now we have hundreds or thousands of people half-assing it locally each time they need it? Doesn't sound efficient.
- esafak 2mo agoI have the same objection to forking open source projects; changes should be upstreamed when possible.
- IAmGraydon 2mo agoIt might make sense to do this if there literally isn't an existing solution out there, but I think most would find that it's better to use an existing solution than to recreate the wheel every time there's a need. It's just less effort/time/money.
- serf 1mo agoyou're right, but flipped on its' head it also means that a well-meaning FOSS project may not ship out a zero-day in the future that affects half the planet at once. now we'll just always be vulnerable from different angles in different and unique ways across the globe. better? well, no.. but it is different, and biology has offered tons of wisdom about why it's a good thing to achieve things different ways across the world, maybe some far-future version of this weird fragmentation of work that is happening now will contribute to some kind of herd effect that reduces the severity or magnitude of some bug or work of malice. who knows though, i'm probably just considering it too positively. The disintegration of consolidated effort is a pita, I agree.
- tecleandor 1mo agoThere has to be a middle ground between a monoculture and not sharing a single knowledge bit between every human. Because if everyone is making their half assed thing just for themselves using LLM without sharing anything, that also means FOSS will stop existing, and knowledge will only evolve inside the corporations that have money for creating their provate knowledge bases.
- classified 2mo agoHow a patchwork of Python modules constitutes an API(?) or whatever(?) and how to use it (does anyone?), is beyond me. There is nothing that I would call documentation, let alone concrete usage examples. I know more amusing ways to waste my time. When I want to play with models, I use llama.cpp.
- akie 2mo agoNo no, don't just say "vibe coded", say "Fable and $500 of credits"
- Lalabadie 2mo ago"This one is made with premium vibes"
- Foobar8568 2mo agoOpus 4.6 was already enough to tackle these projects vibe coding.
- gwerbin 2mo agoIncidentally I think I was more productive with Opus 4.6 than with any subsequent Anthropic model.
- cute_boi 1mo agoYea, opus 4.6 is much better than opus 5 because it is willing to do task. Opus 5 just gaslights and refuses to solve many complex problem.
- moffkalast 1mo agoYes, but with Fable they might actually work in the end. Opus is such trash, malicious compliance and overconfidence personified.
- cyanydeez 2mo agothese things can be done with local models; so don't say 500$ credits, say "accelerated climate change disasters by $500/year"
- ricardobayes 2mo agoOr Deepseek with a fiver.
- mkagenius 1mo agoI love how goal posts are shifting from "vibe coded apps dont really work" to "vide coded projects wont be maintained"