Depending on what models you want to run, RTX 4090 or RTX 3090 may not be enough. Grok-1 was running on a M2 Ultra with 196GB of ram. https://twitter.com/ibab

Depending on what models you want to run, RTX 4090 or RTX 3090 may not be enough. Grok-1 was running on a M2 Ultra with 196GB of ram. https://twitter.com/ibab_ml/status/1771340692364943750 https://twitter.com/ibab_ml/status/1771340692364943750