7 ms·
GPT-5 is kinda pointless until they make some type of improvement on the data and research side. From what I’ve read it’s not really what OpenAI has been pursu
by badcoderman 3y ago
GPT-5 is kinda pointless until they make some type of improvement on the data and research side. From what I’ve read it’s not really what OpenAI has been pursuing it
- Zolde 3y agoOne big improvement is in synthetic data (data generated by LLMs). GPT can "clone" the "semantic essence" of everyone who converses with it, generating new questions with prompts like "What interesting questions could this user also have asked, but didn't?" and then have an LLM answer it. This generates high-quality, novel, human-like, data. For instance, cloning Paul Graham's essence, the LLM came up with "SubSimplify": A service that combines subscriptions to all the different streaming services into one customizable package, using a chat agent as a recommendation engine.
- blovescoffee 3y agoAre you just blindly deciding what will make “gpt-5” more capable? I guess “data and research” is practically so open ended as to encompass the majority of any possible advancement.
- astrange 3y agoThe next improvement will be more modalities (images, sound, etc.) GPT4 in image viewing mode doesn't seem to be nearly as smart as text mode, and image generation IME barely works.
- Davidzheng 3y agoMaybe but I think the next big one will be reasoning.
- astrange 3y agoI think "reasoning" is a descriptive term like "AI" and it's hard to know what people would accept as reasoning. Explicit planning with discrete knowledge is GOFAI and I think isn't workable. There is whatever's going on here: https://x.com/natolambert/status/1727476436838265324?s=46 https://x.com/natolambert/status/1727476436838265324?s=46