Akhiljp

8 ms·

1. 1.▲
   by Akhiljp 3mo ago

   My bad. Wasn’t aware. Thank you. Looking forward to understanding the second part of this. In fireworks - how does one build guardrails or it does not matter to companies hosting their models on fireworks?
2. 2.▲
   by Akhiljp 3mo ago

   Ack on the guardrail analogy. On fireworks - do you just run serverless or do you take their dedicated instance. My question is how do you ensure that the model is not being manipulated to getting stuff it shouldn’t be.
3. 3.▲
   by Akhiljp 3mo ago

   I meant for a model. Like agents could be many within an organization, instead of patching up each agent with a security solution, wouldn’t it be easier to build one that wraps around the model ?
4. 4.▲
   by Akhiljp 3mo ago

   So my first thesis that I want to prove is - are all enterprises going to start self hosting open source models ? If yes, then one will need to deploy a solution around the models to act as a firewall. A firewall fine tuned for the context
5. 5.▲
   by Akhiljp 3mo ago

   I beg to differ - manipulating a model to extract data is worse that protecting sensitive data. I am curious as to why this is not a big space yet?
6. 6.▲
   Discussion – has anyone build a firewall for AI models yet?

   3 points by Akhiljp 3mo ago|11 comments
7. 7.▲
   by Akhiljp 1y ago

   Love the launch, is there a way to add observability tools like langtrace into this so that we know what kind of prompts and inputs are going into the flows?