6 ms·
I have a 3 node proxmox setup on MS-01s using a 25G Thunderbolt ring for Ceph, and indeed it took a lot of hoops to get it working correctly and reliably. I di
by sponaugle 8mo ago
I have a 3 node proxmox setup on MS-01s using a 25G Thunderbolt ring for Ceph, and indeed it took a lot of hoops to get it working correctly and reliably. I did manage to get it such that nodes can go up and down without needing to unplug anything, and the dynamic routing works if a node disappears. Performance is pretty good, with a more realistic 20ish gbit/sec.
- nodesocket 8mo agoI figured this was Jeff’s CTO Laboratory. I enjoy your channel. Are you kicking yourself for pulling the trigger on MS-01s now that MS-02 Ultras released?
- sponaugle 8mo agoYea! Those MS-O2s look great, so I may need to upgrade! I did get a couple of DGX Sparks to play with.
- butvacuum 8mo agoAWESOME!! Do you mind linking references? I put the project aside because of these issues.
- sponaugle 8mo agoYea I'll dig up the link I used - there was a great reference about getting the thunderbolt working after reboots/etc.