3s

6 ms·

1.
I'm Sorry, Dave(world.hey.com)
17 points by 3s 2mo ago|11 comments
2.
by 3s 2mo ago
I think this is true for some tasks where you want a clean slate, but increasingly I find myself constantly referencing specific skills, or having files with prompts I use all the time. I'd much rather have an agent that remembers thin
3.
by 3s 3mo ago
Hi, cofounder of Tinfoil here. We're working on implementing prompt caching. It just requires more work than with traditional, non-private inference and requires some careful considerations to actually implement it.
4.
by 3s 3mo ago
It's a perfect prompt for a rich HN discussion so while in general I agree with you, in this case the discussion is what matters.
5.
by 3s 4mo ago
It's not an unreasonable concern, which is why most US companies prefer to go with AWS bedrock, or even one of the AI labs, and typically request zero data retention agreements. But leaking is a concern no matter where it's hosted
6.
by 3s 4mo ago
I still have the Be My Eyes app installed but haven’t had a call in over a year - I think it’s a testament to how powerful AI vision models have become. I find it cool that AI works well enough for vision impaired people to solve all their
7.
by 3s 4mo ago
Beautiful lecture. As with a lot of things that shape our everyday life we forget to contemplate their qualities. For example fonts subtly impact how we perceive, understand, feel about any text yet we fail to give it much thought as Etienn
8.
Supply Chain Security – Part 1(tinfoil.sh)
1 points by 3s 5mo ago|0 comments
9.
by 3s 5mo ago
> I think if Bob Odenkirk lived on a community farm where everyone had to work together to survive he would be far happier and think life is far more meaningful. So you think everyone was happier in the USSR? /s
10.
by 3s 5mo ago
It’s not top of the line and mostly not open source
11.
by 3s 5mo ago
Not to mention their recent integration of Persona ID verification - that was the last straw for me.
12.
by 3s 5mo ago
But they already have PII on nearly all users. Many user upload documents with their name, or pictures of themselves, or have a chat where home addresses are involved. All of this is information anthropic already has on their users (volunta
13.
by 3s 6mo ago
Yes it appears your personal data IS being sent to open router and the model provider here. The problem I think is that a lot of people (especially in the openclaw community) mistake “I run it on my mac mini” to mean their data is private.
14.
by 3s 7mo ago
The attestation report is produced ahead of time and verified on each connection (before the prompt is sent). Every time the client connects to do an inference request via one of the Tinfoil SDKs, the attestation report is checked relative
15.
by 3s 7mo ago
The attestation is tied to the Modelwrap root hash (the root hash is included in the attestation report) so you know that the machine that is serving the model has the right model weights
16.
by 3s 9mo ago
The absence of solutions for LLM privacy on that list is telling. We’ve figured out how to have private communications with other humans via end to end encryption but arguably we’re leaking a lot more to chatbots about ourselves in a few se
17.
by 3s 9mo ago
It uses confidential computing primitives like Intel TDX and NVIDIA CC, available on the latest generations of GPUs. Secure hardware like this is a building block to enable verifiably private computation without having to trust the operator
18.
by 3s 9mo ago
reminds me of a story called “a disneynand without children” about a planet overtaken by AI pursuing meaningless “inbred” GDP goals and completely neglecting the humans in the process https://open.substack.com/pub/noset
19.
by 3s 1y ago
not to mention the privacy concerns associated with connecting my entire life to OpenAI or Anthropic. If you have the memory feature enabled, it's scary how much ChatGPT knows about you already and can even infer implicit thoughts and
20.
by 3s 1y ago
This is really neat! Didn’t realize it could be this simple to run RL on models. Quick question: How would I specify the reward function for tool use? or is this something you automatically do for me when I specify the available tools and t
21.
by 3s 1y ago
I scraped and plucked them off, not the safest way to get rid of them apparently...
22.
by 3s 1y ago
> Far easier said than done. If it were that easy why even go for the salt? I think it's more gross to pluck it out. Hence why people just pour salt on it or let it finish feeding maybe? Leeches can be really viscerally repulsive to
23.
by 3s 1y ago
I was once hiking in the dark in the south of Japan. I crossed a few streams but didn't think much of it. A while later, I felt like my socks were sticking to my shoes and unusually warm. I looked down to see my ankles and shoes covere
24.
by 3s 1y ago
I think there is a difficult cost benefit analysis with screen sharing. For example, what constitutes PII in that context? Maybe the text on the screen can be extracted and redacted but what about peoples faces? What about website icons in
25.
by 3s 1y ago
This is very clever - I was wondering if there could be a way to use LLMs on planes without paying for wifi (perplexity has been usable via WhatsApp but I’d rather use a different provider). Appreciate the privacy focus too
26.
by 3s 1y ago
We built something similar using secure e enclaves at Tinfoil for verifiably private AI! Unless there is proof of no data access / retention we cannot trust what happens to our data (see recent openAI court ordered retention)
27.
Confidential Inference via Trusted Virtual Machines(anthropic.com)
2 points by 3s 1y ago|0 comments
28.
by 3s 1y ago
I agree with point 1, at least superficially. But re: point 2, there are a lot of companies with close connections to MIT (and other big institutions like Stanford) that are interested in deploying cutting edge research experiments, especi
29.
by 3s 1y ago
That's a big reason why we started Tinfoil and why we use it ourselves. I love the utilities analogy, something that is deeply integrated in business and personal use cases (like the Internet or AI) needs to have verifiable policies an
30.
by 3s 1y ago
This is enforced by the hardware (that’s where the root of trust goes back to NVDIA+AMD). The hardware will only send back signed enclave hashes of the code it’s running and cannot be coerced by us (or anyone else) into responding with a fa

More ›