6 ms·
That's the way things have to go. Business risk is too high having everything ran over exposed networks.
by aswanson 6mo ago
That's the way things have to go. Business risk is too high having everything ran over exposed networks.
- lukewarm707 6mo agowhat i say about this, is that an llm is just a big file, there is nothing 'not private' about it. if you are happy with off-prem then the llm is ok too, if you need on-prem this is when you will need local.
- zahlman 6mo ago> an llm is just a big file, there is nothing 'not private' about it. The private thing is the prompt. But also, a local LLM opens up the possibility of agentic workflows that don't have to touch the Internet.