14 ms·
> Can it run completely on prem ? Yep we have an on-prem offering as well, got similar notes from folks before! > What stops me from building my own logger th
by Akula112233 2y ago
> Can it run completely on prem ?
Yep we have an on-prem offering as well, got similar notes from folks before!
> What stops me from building my own logger that sends a request to write a record to a DB and later asks an LLM what it means ?
Great question! The main limitation over brute force is the sheer volume of noise, and therefore relevant context. We tried this and realized it wasn't working. From a numbers perspective, at even just 10s of GBs/day scale of data (not even close to enterprise scale), mainstream LLMs can't provide the context windows you need for more than a few minutes of operational data. And larger models suffer from other factors (like attention diffusion / dilution & drift).
> I see the landing page. The pricing should be clear though “ Contact Us” is scary.
Noted!
- 999900000999 2y agoThanks! I hope my tone wasn’t too brash. If you can update the pricing I might be able to pitch this to my org later this year. We’d definitely like an on prem solution though!