spencer9714

6 ms·

1. 1.▲
   by spencer9714 5mo ago

   Great work on the AVBD implementation! I’m building a decentralized GPU compute platform (using Node.js/WebGPU). Since the solver uses a 'coloring' approach for parallelism, how do you handle compute preemption or state recov
2. 2.▲
   Show HN: Runfra – Decentralized GPU cluster designed for bulk generation(runfra.com)

   5 points by spencer9714 6mo ago|0 comments
3. 3.▲
   by spencer9714 6mo ago

   Interesting concept. One thing I’m curious about if I’m in a cohort for something like DeepSeek V3 and another user spins up a heavy 24/7 job, how do you keep TTFT from degrading? vLLM’s continuous batching helps, but there’s still a p
4. 4.▲
   by spencer9714 6mo ago

   That BitTorrent analogy is spot on. For Runfra, I’m mostly focusing on the orchestration and inference pipeline. Trying to fix the waiting problem, but also thinking a lot about yield, like how many actually usable outputs you get per run.