8 ms·

What is your evidence for this claim?

• fooker 4mo ago
  They say hill climbing https://microsoft.ai/news/building-a-hillclimbing-machine-launching-seven-new-mai-models/ https://microsoft.ai/news/building-a-hillclimbing-machine-la... Unless they specifically clarify that the testing and training benchmarks are completely separate, we have to assume they test on the same 'hill' the model climbs.
  • ajyoon 4mo ago
    [flagged]
  • jongalloway2 4mo ago
    [dead]
  • artemisart 4mo ago
    Hill climbing doesn't mean much but absolutely doesn't imply they cheat on benchmarks. They have more details here https://microsoft.ai/news/introducing-mai-thinking-1/ https://microsoft.ai/news/introducing-mai-thinking-1/ it seems to be "RL on everything".
    • deleted 4mo ago
      [deleted]