6 ms·
On a M1 MacBook Air with 8GB, I got this running Gemma 3n: 12.63 tok/sec • 860 tokens • 1.52s to first token I'm amazed it works at all with such limited RAM
by davio 1y ago
On a M1 MacBook Air with 8GB, I got this running Gemma 3n:
12.63 tok/sec • 860 tokens • 1.52s to first token
I'm amazed it works at all with such limited RAM
- v5v3 1y agoI have started a crowdfunding to get you a MacBook air with 16gb. You poor thing.
- bookofjoe 1y agoUp the ante with an M4 chip
- backscratches 1y agonot meaningfully different, m1 virtually as fast as m4
- wahnfrieden 1y agohttps://github.com/devMEremenko/XcodeBenchmark https://github.com/devMEremenko/XcodeBenchmark M4 is almost twice as fast as M1
- andai 1y agoIn this table, M4 is also twice as fast as M4.
- wahnfrieden 1y agoYou're comparing across vanilla/Pro/Max tiers. within equivalent tier, M4 is almost 2x faster than M1
- v5v3 1y agoTwice the cost too.
- wahnfrieden 1y ago?
- AtlasBarfed 1y agoY not meeee? After considering my sarcasm for the last 5 minutes, I am doubling down. The government of the United States of America should enhance its higher IQ people by donating AI hardware to them immediately. This is critical for global competitive economic power. Send me my hardware US government
- xwolfi 1y agohigher IQ people <-- well you have to prove that first, so let me ask you a test question to prove them: how can you mix collaboration and competition in society to produce the optimal productivity/conflict ratio ?