5 ms·
There's been some work (e.g RASP - https://arxiv.org/abs/2106.06981 https://arxiv.org/abs/2106.06981) on taking logical computations and compiling them into tra
by leogao 10mo ago
There's been some work (e.g RASP - https://arxiv.org/abs/2106.06981 https://arxiv.org/abs/2106.06981) on taking logical computations and compiling them into transformer weights.
- astrange 10mo agoSakana AI is also working on merging different transformer models together to combine skills. https://sakana.ai/evolutionary-model-merge/ https://sakana.ai/evolutionary-model-merge/