5 ms·
Excellent news. I’ve been worried that Sam moving to Microsoft would stall out possible future engineering efforts like GPT-5 in IP court. As an example of how
by pdx6 3y ago
Excellent news. I’ve been worried that Sam moving to Microsoft would stall out possible future engineering efforts like GPT-5 in IP court.
As an example of how much faster GPT-4 has made my workflow was the outage this evening — I tried Anthropic, openchat, Bard, and a few others and they were between not useful and worse than just looking at forums and discord it’s 2022.
- sidcool 3y agoI still feel Microsoft will have a bigger influence on OpenAI after this drama is over.
- badcoderman 3y agoGPT-5 is kinda pointless until they make some type of improvement on the data and research side. From what I’ve read it’s not really what OpenAI has been pursuing it
- Zolde 3y agoOne big improvement is in synthetic data (data generated by LLMs). GPT can "clone" the "semantic essence" of everyone who converses with it, generating new questions with prompts like "What interesting questions could this user also have asked, but didn't?" and then have an LLM answer it. This generates high-quality, novel, human-like, data. For instance, cloning Paul Graham's essence, the LLM came up with "SubSimplify": A service that combines subscriptions to all the different streaming services into one customizable package, using a chat agent as a recommendation engine.
- blovescoffee 3y agoAre you just blindly deciding what will make “gpt-5” more capable? I guess “data and research” is practically so open ended as to encompass the majority of any possible advancement.
- astrange 3y agoThe next improvement will be more modalities (images, sound, etc.) GPT4 in image viewing mode doesn't seem to be nearly as smart as text mode, and image generation IME barely works.
- Davidzheng 3y agoMaybe but I think the next big one will be reasoning.
- astrange 3y agoI think "reasoning" is a descriptive term like "AI" and it's hard to know what people would accept as reasoning. Explicit planning with discrete knowledge is GOFAI and I think isn't workable. There is whatever's going on here: https://x.com/natolambert/status/1727476436838265324?s=46 https://x.com/natolambert/status/1727476436838265324?s=46