10 ms·I think you mean mostly-stateless-but-with-prompt-caching-and-batching, ie not reallyby anuramat 2mo agoI think you mean mostly-stateless-but-with-prompt-caching-and-batching, ie not really