WeirderScience

6 ms·

1. 1.▲
   by WeirderScience 1y ago

   arXiv link for the paper: https://arxiv.org/pdf/2506.08257 (Note that the author Lukas Beyer is distinct from the other well-known author in the field, Lucas Beyer)
2. 2.▲
   by WeirderScience 1y ago

   Their sketchy ad/malware era aside, I do appreciate sourceforge keeping all the old OSS websites and repos alive.
3. 3.▲
   by WeirderScience 1y ago

   If you find this kind of stuff interesting, I'd strongly recommend checking out the book "Spark: The Life of Electricity and the Electricity of Life" by Jorgensen
4. 4.▲
   by WeirderScience 1y ago

   Looking forward to Casey Muratori's talk!
5. 5.▲
   by WeirderScience 1y ago

   I wonder if this is a result of the previously reported clashes between OpenAI and Microsoft over access to the Windsurf IP (under their investment agreement)
6. 6.▲
   by WeirderScience 1y ago

   Yeah, I suspect you're right. Still, even a list of URLs for a frontier model (assuming it does turn out to be of that level) would be welcome over the current situation.
7. 7.▲
   by WeirderScience 1y ago

   The open training data is a huge differentiator. Is this the first truly open dataset of this scale? Prior efforts like The Pile were valuable, but had limitations. Curious to see how reproducible the training is.