6 ms·
The moat is building GPU infrastructure to serve inference at scale.
by mmcwilliams 8mo ago
The moat is building GPU infrastructure to serve inference at scale.
- troyvit 8mo agoNot just building GPU infrastructure to serve inference at scale, but also constraining GPU infrastructure and pricing it out of reach for individuals who wish to pursue open models. I'm not sure what entirely to do about it, but the fact that some providers still release open models is hopeful to me.