jgammell

8 ms·

1. 1.▲
   by jgammell 5mo ago

   > hybrid Mamba/Gated linear attention layers, Do any large-scale architectures use mamba? I was under the impression that people don't use it yet due to lack of efficient implementations. > Training is also vastly more sophi
2. 2.▲
   by jgammell 6mo ago

   When sampling from an LLM people normally truncate the token probability distribution so that low-probability tokens are never sampled. So the model shouldn't produce really weird outputs even if they technically have nonzero probabili
3. 3.▲
   by jgammell 6mo ago

   > Generative models are probabilistic: the output will be less likely to satisfy complex requirements, particularly This is a misinformed 'critique' which always gets on my nerves, as someone who actually works with AI. The wor
4. 4.▲
   by jgammell 8mo ago

   My university made us learn to code 'close to the metal' and IMO this is a great way to gain an understanding of what is actually going on. Program in C, no IDE, no AI tools. The AI tools are incredibly helpful (and people who say