8 ms·
> I don't have 30k bucks to spare on a gpu :( Do you have $2/hr to rent an RTX 6000 96GB or $5/hr for B200 180GB on the cloud?
by eleventyseven 7mo ago
> I don't have 30k bucks to spare on a gpu :(
Do you have $2/hr to rent an RTX 6000 96GB or $5/hr for B200 180GB on the cloud?
- superkuh 7mo agoI'd rather not give money to scalper barons if I can avoid it. Fab capacity is going to that for rental rather than hardware for humans.
- xaskasdf 7mo agoI thought about that, but idk if they allow me to modify the linux kernel and nvidia cuda kernel at all
- green-salt 7mo agoI think you can do a bunch of that on Digitalocean's GPU droplets.
- jonassm 7mo agoIn those systems you could probably leverage something like Nvidia SCADA or GDS directly.
- xaskasdf 7mo agoActually since they have direct GDS it should perform really well on professional gpus