30 ms·
Let the AI efficiency olympics begin! On a laptop, on a desktop, on a phone? Train for 5 minutes, an hour, a day, a week? On a boat? With a goat?
by aniijbod 1y ago
Let the AI efficiency olympics begin!
On a laptop, on a desktop, on a phone?
Train for 5 minutes, an hour, a day, a week?
On a boat? With a goat?
- visarga 1y agogoats have too many parameters, they are like GPT-4
- hinkley 1y agoGO4-T
- rPlayer6554 1y agoI’d pay for GoatLM
- Nevermark 1y agoOn a maxxxed out Mac Studio M3 Ultra 512GB. That boat will float your goat!
- evanmoran 1y agoThis literally is fast enough to really whip the llamas.. well, you know. And for the younger folk, this mp3 player was the precursor to Spotify: https://youtu.be/HaF-nRS_CWM?si=d7WHzkV7CFHJ2hGg https://youtu.be/HaF-nRS_CWM?si=d7WHzkV7CFHJ2hGg
- lifestyleguru 1y agoHonestly AI is a trick to make us buy new expensive computers. I'm writing this from over 10 years old one and the computers offered in a leaflet from nearby electronic store aren't much better.
- voidUpdate 1y agoI mean, gaming is the big pusher of new hardware these days, and web is basically the reason you can use a 90s computer in the modern day. I happily survived on roughly 10 year old components all the way through university because I wasn't playing AAA games
- throwawaylaptop 1y agoMy parents bought a new laptop for their general household use and to watch YouTube via HDMI on their tv. It was so annoying and weird and not even fast, that they returned it to Costco for the $800 within 90 days. I setup a 10 year old computer for them instead running Linux Mint Mate and it's perfect.
- smohare 1y ago[dead]
- 542354234235 1y agoAnyone who remembers the 90s and 2000s, where your computer hardware was out of date within months, might disagree. If you want to do bleeding edge things like running 70b+ LLMs locally or doing training, you need bleeding edge hardware. No different than if you want to play the newest AAA games. There are plenty of games you can play with old hardware, and plenty of small LLMs. When you can use ChatGPT or a bunch of other services, it isn’t a trick that some people want to host their own or do training, but you need a system that can do that.
- aniijbod 1y agoOh no! I thought that was Windows 11
- yojo 1y ago> With a goat? I think you meant Llama. The rhymes are admittedly more limited, unless you have a Boston accent.
- jdjdndndn 1y agoI do not like been eggs and ham. I do not like them Sam I am. Dr Seuss ftw
- cameronoliver 1y ago"On a boat? With a goat?" is a quote from Green Eggs and Ham, an early-reader children's book by Dr Seuss, published in 1960.
- lcfcjs6 1y ago[dead]
- hinkley 1y agoVernor Vinge has a story line where humans build their own portable chess computers and utilize them as assistants in human chess matches. I still think this would be kinda cool. I could see a tournament providing the power source in addition to the chess clock. Then gamesmanship where you play moves you hope are expensive for the opponent but not for your own AI.