6 ms·
Unless you infinitely increase the context window, its memory will always be limited. And their latest ARC3 result with and without harness demonstrates how imp
by 10xDev 13d ago
Unless you infinitely increase the context window, its memory will always be limited. And their latest ARC3 result with and without harness demonstrates how important not discarding memory is for learning.
- dlubarov 12d agoI also have limited memory though; surely that doesn't disqualify me from possessing general intelligence? Granted I have more memory than can fit in currently-practical LLM context windows, but RAG mostly solves that. When an AI is thinking about math, it can have relevant math memories in context without needing all the other stuff.