5 ms·

I wonder how sustainable the free model is for ai startups. This shows how you can switch easily from one to another. Maybe we are in the golden days like back

I wonder how sustainable the free model is for ai startups. This shows how you can switch easily from one to another. Maybe we are in the golden days like back when Uber was cheap…

verdverm 2y ago
For Uber, car prices and salaries go up over time naturally For computing, silicon has become cheaper and more efficient over time I expect a race to the bottom and then some stabilization, much like we have seen in general cloud computing, and have seen with token prices
- bravetraveler 2y ago
  The bottom can still be pretty high! Storage has become an order of magnitude cheaper, yet I still don't bother with block storage pricing Dedicated or S3 is where it's at, still plenty of room for gamification
- daghamm 2y ago
  "For Uber, car prices and salaries go up over time naturally" Or, your VC money runs out and you start treating your gig workers like crap to save a few cents here and there.
- hoerzu 2y ago
  The point is the VC money funding something unsustainable (burning through billions). Token prices will never be zero IMO.
  - meiraleal 2y ago
    Yes they will. They are already, if you run local models, that are only getting better. There are 7-11B models that are as good as ChatGPT 3.5
    - hoerzu 2y ago
      Ok, but running a 11B model gets things 60% of the time right and consumes maximum of electricity of your machine. Not sure if that makes you product the best. Further video generation is very compute intensive. I guess price will decrease over time but the technical advance will allways be for the smarter model
      - meiraleal 2y ago
        > and consumes maximum of electricity of your machine OpenAI isn't a eletricity company so the token prize is still zero for what is worth for VCs. > but the technical advance will allways be for the smarter model Not true. Currently, the small models are advancing much faster with daily new releases
    - chatmasta 2y ago
      Token costs are not zero when you’re running local models, because you paid for the hardware, and you can’t scale inference indefinitely without paying for more hardware.

I wonder how sustainable the free model is for ai startups. This shows how you can switch easily from one to another. Maybe we are in the golden days like back when Uber was cheap…

verdverm 2y ago

For Uber, car prices and salaries go up over time naturally For computing, silicon has become cheaper and more efficient over time I expect a race to the bottom and then some stabilization, much like we have seen in general cloud computing, and have seen with token prices

bravetraveler 2y ago
The bottom can still be pretty high! Storage has become an order of magnitude cheaper, yet I still don't bother with block storage pricing Dedicated or S3 is where it's at, still plenty of room for gamification
daghamm 2y ago
"For Uber, car prices and salaries go up over time naturally" Or, your VC money runs out and you start treating your gig workers like crap to save a few cents here and there.
hoerzu 2y ago
The point is the VC money funding something unsustainable (burning through billions). Token prices will never be zero IMO.
- meiraleal 2y ago
  Yes they will. They are already, if you run local models, that are only getting better. There are 7-11B models that are as good as ChatGPT 3.5
  - hoerzu 2y ago
    Ok, but running a 11B model gets things 60% of the time right and consumes maximum of electricity of your machine. Not sure if that makes you product the best. Further video generation is very compute intensive. I guess price will decrease over time but the technical advance will allways be for the smarter model
    - meiraleal 2y ago
      > and consumes maximum of electricity of your machine OpenAI isn't a eletricity company so the token prize is still zero for what is worth for VCs. > but the technical advance will allways be for the smarter model Not true. Currently, the small models are advancing much faster with daily new releases
  - chatmasta 2y ago
    Token costs are not zero when you’re running local models, because you paid for the hardware, and you can’t scale inference indefinitely without paying for more hardware.