DeveloperErrata

6 ms·

1.
An off switch for dual-use knowledge in AI models(anthropic.com)
3 points by DeveloperErrata 2mo ago|1 comments
2.
An off switch for dual use knowledge in AI models(anthropic.com)
5 points by DeveloperErrata 2mo ago|0 comments
3.
by DeveloperErrata 8mo ago
Not quite, most of the recent work on modern RNNs has been addressing this exact limitation. For instance linear attention yields formulations that can be equivalently interpreted either as a parallel operation or a recursive one. The conse
4.
by DeveloperErrata 1y ago
This was really educational to me, felt at the perfect level of abstraction to learn a lot about the specifics of LLM architecture without the difficulty of parsing the original papers
5.
by DeveloperErrata 1y ago
Don't know how Grok is setup, but in earlier models the vision backbone was effectively a separate model that was trained to convert vision inputs into a tokenized output, where the tokenized outputs would be in the form of "soft
6.
by DeveloperErrata 1y ago
Consider the difference between the requirements to simulate the universe and simulate a person's experience of the universe. As people in the universe, we wouldn't be able to tell the difference, but the latter would be have much
7.
by DeveloperErrata 1y ago
Trueish - for orgs that can't use API models for regulatory or security reasons, or that just need really efficient high throughput models, setting up your own infra for long context models can still be pretty complicated and expensive
8.
by DeveloperErrata 1y ago
Increasingly so. Many other popular inference tools in this space also expose an OpenAI compatible API: VLLM, Llama.cpp, and LiteLLM all do.
9.
by DeveloperErrata 2y ago
Seems like this would (eventually) be big for VR applications. Especially if the avatar could be animated using sensors installed on the headset so that the expressions match the headset user. Reminds me of the metaverse demo with Zuckerber
10.
by DeveloperErrata 2y ago
Macbook Pros with M3 & integrated RAM & VRAM can do 70B models :)
11.
by DeveloperErrata 2y ago
I want to plug the Little Big Planet series of games, it's what got me into programming when I was young and I think it still has a lot of charm
12.
by DeveloperErrata 2y ago
I agree, a naive approach to approximate caching would probably not work for most use cases. I'm speculating here, but I wonder if you could use a two stage pipeline for cache retrieval (kinda like the distance search + reranker model
13.
by DeveloperErrata 2y ago
Seems neat - I'm not sure if you do anything like this but one thing that would be useful with RAG apps (esp at big scales) is vector based search over cache contents. What I mean is that, users can phrase the same question (which has
14.
by DeveloperErrata 2y ago
It's neat to see this getting attention. I've used similar techniques in production RAG systems that query over big collections of HTML docs. In our case the primary motivator was higher token efficiency (ie to represent the same
15.
Show HN: AI-Powered Vintage Interactive Fiction Interpreter(github.com)
3 points by DeveloperErrata 3y ago|1 comments
16.
by DeveloperErrata 3y ago
I love old school interactive fiction games (like Zork, etc) but find the strict syntax endlessly frustrating. I built this ChatGPT powered "middleman" to translate commands written in natural language into something understandabl