14 ms·
It's possible, yeah. The system is general enough that it would work. I'm considering exposing an API version. You set up a shared memory, then you hit the API
by adjohu 29d ago
It's possible, yeah. The system is general enough that it would work.
I'm considering exposing an API version. You set up a shared memory, then you hit the API as if it were an LLM. The underlying model could be configurable, the shared memory would be handled opaquely.