hipmanbro

5 ms·

1. 1.▲
   by hipmanbro 3y ago

   There were a few reasoning benchmarks that I noticed think they omitted a direct comparison since they weren't as competitive compared to GPT-4, and instead opted to just show the benchmarks comparing itself to other versions of PaLM o
2. 2.▲
   by hipmanbro 3y ago

   It's a good proxy for both. Both popularity and volatility have misleading statistical failure modes if measured purely by pull requests. The author did narrow it down into what it mostly accurate represents though: > Nevertheless,
3. 3.▲
   by hipmanbro 3y ago

   One of the worries I have is that the grand prize is so top weighted. It feels daunting to want to attempt to work on something like this if there's only one winner. If my team isn't the first to win it, but we contribute an inter
4. 4.▲
   by hipmanbro 4y ago

   > making someone else's argument fit into your own system without misrepresenting it or making it unclear I think this is where steelman is a superset of this, in that it includes the reconstruction definition but also includes maki
5. 5.▲
   by hipmanbro 4y ago

   It's not the same in that you can steelman a position and come up with brand new arguments that are better than what the other side is saying. "Reconstructing" doesn't necessitate the strongest form of the other argument