5 ms·

Great starting point! These diagrams notably miss a LLM firewall layer, which is critical in practice to safe LLM adoption. Source: We work with thousands of us

by akisej 3y ago

Great starting point! These diagrams notably miss a LLM firewall layer, which is critical in practice to safe LLM adoption. Source: We work with thousands of users for logicloop.com/ai

applgo443 3y ago
What do you mean by firewall layer? What tools do you use here?
- __loam 3y ago
  I imagine he's talking about preventing prompt injection (or making shit up)
  - lukasb 3y ago
    That doesn't seem like the type of problem that can be solved with a drop-in solution.
    - __loam 3y ago
      No but that won't stop them from making a startup to sell you some snake oil that doesn't work!
    - applgo443 3y ago
      I think we can detect atleast a few things like PII leaks etc. Don't you think those things alone are valuable?
  - akisej 3y ago
    Yup, that's part of it but I mean it bidirectionally - users can accidentally leak data to models too, which is concerning to SecOps teams without a way to monitor / auto-redact.
- akisej 3y ago
  These common issues tend to prevent LLMs from being used in the wild: * Data Leakage * Hallucination * Prompt Injection * Toxicity So yes it does include prompt injection, but is a bit broader. Data Leakage is one that several customers have called out, aka accidentally leakage PII to underlying models when asking them questions about your data. I'm evaluating tools like Private AI, Arthur AI etc. but they're all fairly nascent.
  - applgo443 3y ago
    I’m a researcher in the space exploring few ideas with the intention of starting up. Would love to reach out to you and talk to you. Is there a way I can contact you? My email is beady.chap-0f@icloud.com