6 ms·
It gives you a wrong perspective, especially if you are distracted, on model capabilities: Fable 5.1 is not 30% better than Sol, but is the very first impressio
by vb-8448 14d ago
It gives you a wrong perspective, especially if you are distracted, on model capabilities: Fable 5.1 is not 30% better than Sol, but is the very first impression you get when you look at the first graph.
If I'm not wrong OAI tried a similar trick when GPT5 was announced ... they have been criticized a lot.
- BeetleB 14d ago> It gives you a wrong perspective, especially if you are distracted, on model capabilities Only if you aren't schooled in reading graphs. It's a given that you always have to look at the axes when interpreting a graph. How exactly would you zoom into a section of a graph and just show that section?
- Sharlin 14d agoNot starting at zero has long been used entirely intentionally in order to mislead people, particularly the general public.
- vb-8448 14d ago> Only if you aren't schooled in reading graphs ... So we can say the same about the authors "AA’s plot is misleading" claim, he is "not schooled in reading graphs"? > How exactly would you zoom into a section of a graph and just show that section? When building a chart is good practice to provide log scale switch and zoom&pan capabilities, so the reader can decide how to look at it.
- BeetleB 14d ago> So we can say the same about the authors "AA’s plot is misleading" claim, he is "not schooled in reading graphs"? Oh absolutely - as other commenters have pointed out. > When building a chart is good practice to provide log scale switch and zoom&pan capabilities, so the reader can decide how to look at it. For the majority of the time charts have existed, your "good practice" would have been impossible. Charts have historically been static images (e.g. published in a journal). So there have been conventions on how to depict them - and at times it is very appropriate to start from something other than 0. Here's an article from the UK's Office For National Statistics: https://digitalblog.ons.gov.uk/2016/06/27/does-the-axis-have-to-start-at-zero-part-1-line-charts/ https://digitalblog.ons.gov.uk/2016/06/27/does-the-axis-have...
- vb-8448 14d agoI agree on the past, when you have limited resource and have to print something on paper that you cannot recall to fix you have to carefully choose the layout. But that era is gone since decades, nowadays, given how easy it is, it's a shame to not provide log scale switch and zoom&pan capabilities.
- BeetleB 14d agoEh no. Expecting a non-programmer to be able to generate this is very elitist. A static image is still the standard.
- vb-8448 14d agoThe author's job description is literally "Staff Software Engineer at OpenTeams. Dask maintainer."!
- BeetleB 14d agoThe discussion isn't about what one person should do, but on what is appropriate in general for depicting such graphs. What he did do is in line with current and long standing recommendations.