6 ms·
Apple is working from the 'desktop' up to beefy servers with 64GB+ RAM. Nvidia is working from the 'datacenter' down to beefy racks with terabytes of RAM. The
by AdamN 15d ago
Apple is working from the 'desktop' up to beefy servers with 64GB+ RAM. Nvidia is working from the 'datacenter' down to beefy racks with terabytes of RAM.
There isn't really an overlap yet.
Individual Nvidia cards exist on desktops but they're not really oriented for regular inference so individual developers are left with Macs or datacenter resources as their options.
- whatsThisBtn4 14d agoUh... Even my $700 laptop with a 3060 can run 9b models.