5 ms·
Funny I casually asked Gemini and it said 500k for unquantized with decent throughput.
by uberex 3mo ago
Funny I casually asked Gemini and it said 500k for unquantized with decent throughput.
- stymaar 3mo agoThis is why you shouldn't believe uncritically an answer from an LLM (neither should you do for any answer from a human either though).
- andy_ppp 3mo agoBut I did my research online and the sun cycle is every 11 years and something something global warming is a hoax every single year now.
- j45 3mo agoLLMs aren't discrete calcluators or estimators of things unless framed and guided to do so.
- uberex 3mo agoGood job I didn't use a vanilla LLM without tool use harness then.
- colinsane 3mo agoi asked gemini and it replied with "Error: 400 Your prompt was blocked by safety filters. Please revise and try again."
- digitaltrees 3mo agoI asked and it said “403 forbidden - careful peon attempts to bypass the late stage capitalism api with your monetary offerings in exchange for you daily tokens will get you perma banned right to jail”.
- matheusmoreira 3mo agoSafety from competition!
- nijave 3mo agoThat's fair for new hardware. You probably want to prompt "homelab" or "used hardware" to compare what's in this thread.