7 ms·

Good ideas are usually still good across time and tools

by glasss 2mo ago

tiffanyh 2mo ago
Exactly High quality, fast & cheap (all 3 combined) - is a formula success. It’s just way easier said than done.
- Avicebron 2mo ago
  There's a reason most pros will tell you pick two of the three.
onlyrealcuzzo 2mo ago
Dogpile was only a good idea while Search Engines were mostly trash. You needed to search all of them to find something decent. That's roughly analogous to today. Ignoring cost, you'd be way better off asking all the LLMs to solve a problem (like coding) where you can verify the answer. So the question is, for things like that -> can a group of models perform better than frontier models, especially at a reasonable cost? Fable is not a great value, so unless you're trying to find answers to Erdos questions, you can probably do better on cost. You can probably typically ask 3 or 4 of the top Chinese models for an answer and get a response for the same Fable question... Given that Fable isn't that much better, it's not surprising you can do better for a large subset of problems.
- Terretta 2mo ago
  > Dogpile was only a good idea while Search Engines were mostly trash. Precisely.
  - deleted 2mo ago
    [deleted]
  - user_7832 2mo ago
    LLMs fail in such bizzare, obscure methods (to the average observer) at times. Sometimes even simple questions ("who was that x person who was super famous I'm thinking of") type questions fail terribly. The more vague and non committal and hand-wavey and subjective the field for AI to answer, the better the results (imo).
    - rablackburn 2mo ago
      I daresay it's because the assistant training corpus is heavily biased towards one-shot solution answers. Because the correct response to that query is "I have no idea -- you will need to provide more information" and LLM Agents suck at that.
- ai-x 2mo ago
  There is no reason a smarter model will not build an internal smarter/efficient router itself
- joe_the_user 2mo ago
  Dogpile was only a good idea while Search Engines were mostly trash. Well, search engines are trash again. Perhaps it should come back
  - onlyrealcuzzo 2mo ago
    > Well, search engines are trash again. That's mostly because the ability to make money on the web made the web trash. When you couldn't monetize your websites, everyone's websites were passion projects. Now everyone is trying to figure out how they can make $8M a year off yet another recipe website.

Good ideas are usually still good across time and tools

by glasss 2mo ago

Good ideas are usually still good across time and tools

tiffanyh 2mo ago

Exactly High quality, fast & cheap (all 3 combined) - is a formula success. It’s just way easier said than done.

Avicebron 2mo ago
There's a reason most pros will tell you pick two of the three.

onlyrealcuzzo 2mo ago

Dogpile was only a good idea while Search Engines were mostly trash. You needed to search all of them to find something decent. That's roughly analogous to today. Ignoring cost, you'd be way better off asking all the LLMs to solve a problem (like coding) where you can verify the answer. So the question is, for things like that -> can a group of models perform better than frontier models, especially at a reasonable cost? Fable is not a great value, so unless you're trying to find answers to Erdos questions, you can probably do better on cost. You can probably typically ask 3 or 4 of the top Chinese models for an answer and get a response for the same Fable question... Given that Fable isn't that much better, it's not surprising you can do better for a large subset of problems.

Terretta 2mo ago
> Dogpile was only a good idea while Search Engines were mostly trash. Precisely.
- deleted 2mo ago
  [deleted]
- user_7832 2mo ago
  LLMs fail in such bizzare, obscure methods (to the average observer) at times. Sometimes even simple questions ("who was that x person who was super famous I'm thinking of") type questions fail terribly. The more vague and non committal and hand-wavey and subjective the field for AI to answer, the better the results (imo).
  - rablackburn 2mo ago
    I daresay it's because the assistant training corpus is heavily biased towards one-shot solution answers. Because the correct response to that query is "I have no idea -- you will need to provide more information" and LLM Agents suck at that.
ai-x 2mo ago
There is no reason a smarter model will not build an internal smarter/efficient router itself
joe_the_user 2mo ago
Dogpile was only a good idea while Search Engines were mostly trash. Well, search engines are trash again. Perhaps it should come back
- onlyrealcuzzo 2mo ago
  > Well, search engines are trash again. That's mostly because the ability to make money on the web made the web trash. When you couldn't monetize your websites, everyone's websites were passion projects. Now everyone is trying to figure out how they can make $8M a year off yet another recipe website.