14 ms·
Yann LeCun's response is interesting. I've heard that the transformer architecture underlying LLMs is actually really effective for robotics, but progress is a
by nostrademons 23d ago
Yann LeCun's response is interesting. I've heard that the transformer architecture underlying LLMs is actually really effective for robotics, but progress is a lot slower here because instead of just scraping the web and Anna's Archive, you have to outfit workers with motion-capture suits that record their every move, and then have them physically do enough jobs that you can gather good training data on how the job is done. This is a little challenging when no blue-collar worker wants to be replaced by a robot.
Long-term there's probably a lot more potential, and much bigger markets, in robotics than in LLMs, but it will really take the long term to get there.