6 ms·
If they really didn't test anything bigger than 13b, as their abstract states, then this doesn't even seem worth reading through.
by throwaway6977 3y ago
If they really didn't test anything bigger than 13b, as their abstract states, then this doesn't even seem worth reading through.
- wmf 3y agoThe "Google has no moat" thing claimed that Vicuna-13B was almost as good as ChatGPT and this paper seemingly refutes that.
- ShamelessC 3y agoClaims made in a leaked blog post shouldn't be considered as having any sort of scientific authority. That whole "no moat" piece has exactly the tone I would expect from an over-confident Googler who has essentially been following all of this by watching various Discord channels and browsing hacker news. That isn't how science is done. It shouldn't be how business is done, but people seem to really enjoy these everything-is-actually-simple narratives.
- space_fountain 3y agoThat claim wasn't sourced from the Google has no moat paper, but from the announcement for Vicuna-13B if I recall (or some other similar model). It shouldn't be taken as an independent quality assessment
- nptacek 3y agomy eyebrows went up at a number of choices made in their assessment
- Sai_ 3y agoCould you explain what other choices were red flags for you? I’m somewhat familiar with the open source LLMs space but not enough to know why some choices are better than others.