9 ms·
BTW, I also tried to make a entire LLM-driven bot to play boardgames like chess or mahjong, but it has the same latency issues since most of the online platform
by swrrt 1mo ago
BTW, I also tried to make a entire LLM-driven bot to play boardgames like chess or mahjong, but it has the same latency issues since most of the online platforms have strict per-turn time limit like 15-30s, which is almost impossible for LLM/agent to react in time.