19 ms·
Don't worry about Jesus, he's fine. I'm the same as you sans 10 years of working experience, with similar experiences using LLMs. The distinction I would like
by fyredge 14d ago
Don't worry about Jesus, he's fine.
I'm the same as you sans 10 years of working experience, with similar experiences using LLMs. The distinction I would like to make is that it's not the models that are improving, but rather the infrastructure around them. It started with prompt engineering, then chain-of-thought, then mixture-of-experts, now harness engineering etc. These, I think are what's driving LLM complexity, not the model.
To bring back to your electric car analogy, the electric motor peaked early on, but was not quite useful as a car until advancements in battery density, charging technology, regenerative braking were made. These are all the infrastructure needed to improve the viability of owning electric cars, just like the infrastructure was needed to make the models useful.
To be honest, I'm much more excited to see development of infrastructure around local models than seeing the arms race between AI labs. At least the former benefits the end user in a transparent way.