eso_logic

9 ms·

1.
by eso_logic 2mo ago
This is a great datapoint. Someone else brought up that I should be memory checking the GPUs to understand if things are breaking down.
2.
by eso_logic 2mo ago
Lesson learned for real, and TIL matplotlib is happy to export SVG. Good to know for next time. I upgraded my lightsail instance size in the meantime.
3.
by eso_logic 2mo ago
I'm trying bruh fuck!
4.
by eso_logic 2mo ago
Yes! P4 and the other small cards are fantastic. I've been more focused on developing a cooling system around the 2 slot sized cards so I don't have any of these lying around. Are you using P4 for anything outside of LLM work? I&#
5.
by eso_logic 2mo ago
16 GPUs would require one or more 220V breaker panels, more akin to an EV charger than a computer. You would also quickly run out of PCIe lanes. My goal with this benchmarking is to think about what is the most cost effective way to fill 4U
6.
by eso_logic 2mo ago
No problem. Varying context size is a common request I've been getting as well. Personally I'm looking forward to seeing how much we can cram into the ancient K80's 24GB of VRAM :0
7.
by eso_logic 2mo ago
This initial round of benchmarking was to understand if there was any usecase here at all and I think there is. In a follow up, I'll be trying to answer questions like this. How big of a model can you fit on 4x M60, 4x P100, 4x V100? W
8.
by eso_logic 2mo ago
Thanks! Yeah this is a major consideration. I have looked at power consumption throughout runs in the past ( https://esologic.com/gpu-server-benchmark/#gpu-box-benchmark ) and found that for many of these enterprise clas
9.
by eso_logic 2mo ago
Wow holy crap this is news to me! I will have to consider picking some of these up for testing, what is it like working with them?
10.
Benchmarking 15 “E-Waste” GPUs with Modern Workloads(esologic.com)
141 points by eso_logic 2mo ago|64 comments
11.
Nintendo Switch Teardown(youtube.com)
1 points by eso_logic 10y ago|0 comments
12.
NEC Display Solutions Announces Collaboration with Raspberry Pi(nec-display-solutions.com)
2 points by eso_logic 10y ago|0 comments