6 ms·
We Hit 100% GPU Utilization–and Then Made It 3× Faster by Not Using It
- martianlantern 1y agoThere's no explanation as to how they achieved that speed up :( it would have been better if they also wrote a post on that
- sync 1y agoyeah, just feels like an ad for daft...
- garyfirestorm 1y ago> That story’s for another post, but first, here’s the recipe that got us to near-100%. From the article - it states that speed up is part of next post.
- marcinzm 1y agoThen that’s a very inaccurate click bait title for this post.
- DrBenCarson 1y agoScammy post
- amelius 1y agoSounds like some basic plumbing that an LLM should be able to do.
- 3eb7988a1663 1y agoSomething tells me they are calculating utilization in a non-standard way. While I have no doubt there is room for clever pipelining of data, to say you cut out all memory transfer overhead sounds ridiculous. If they did, Zuckerberg will cut them a $5+ billion check today.
- deleted 1y ago[deleted]
- antithesizer 1y agohmm maybe that's why they didn't post it
- 3eb7988a1663 1y agoThen they should fire their marketing team.
- v3ss0n 1y agoOk nice clickbaiting, post your 3x speed up part and we will talk
- cesarvarela 1y agoPosts like these should have an [inbound] tag or something like that.