6 ms·
its fast but try to get it to give you pi to 50 decimal places. it didnt go well for me.
by phoh 1mo ago
its fast but try to get it to give you pi to 50 decimal places. it didnt go well for me.
- walrus01 1mo agoI think the same exact model running on CPU-only and RAM, or a small GPU, would do about the same? It's quite an old model now and small, you could throw a GGUF into llama-server or something for a side by side comparison. https://huggingface.co/meta-llama/Llama-3.1-8B https://huggingface.co/meta-llama/Llama-3.1-8B As I remember just about any english language model from mid 2024 and earlier didn't even do well if you asked it to count sequentially from 0 to 100, nevermind calculating stuff.
- estearum 1mo agoThat's not how LLMs work