10 ms·

There's a shockingly unfathomable level of data compression that these local LLMs are able to remember in an encyclopedic way, so many obscure little things.

• IsTom 2mo ago
  Is it? Compressed (text) Wikipedia is in ballpark of dozens of GBs.
  • maest 2mo ago
    Dozens of GBs of compressed text is an unfathomable amount of information from a human POV.