8 ms·
Fixed :) Turned out to be a race condition where the groq inference task completed before the sse client could subscribe to that inference, and internally the
by mrbnprck 2mo ago
Fixed :)
Turned out to be a race condition where the groq inference task completed before the sse client could subscribe to that inference, and internally the sse connection couldn't be used to fetch already completed inferences.