4 ms·

GPT-4 is absolutely incredible and even if we never get beyond it the world is a much better place with it than without it. It makes total sense to bet on the t

by invig 2y ago

GPT-4 is absolutely incredible and even if we never get beyond it the world is a much better place with it than without it. It makes total sense to bet on the team that made this being the best placed people in the world to advance it.

FlamingMoe 2y ago
So the ends justify the means?
fromMars 2y ago
From what I can tell, all the GPT team did was scale up ideas already there invented elsewhere in previous large language models. I am not sure that is a reason to bet on them making any breakthroughs needed for AGI.
- gizmo 2y ago
  OpenAI also pioneered reinforcement learning from human feedback (RLHF) to make LLMs output completions that are valuable/relevant. I agree that OpenAI has provided no evidence they are anywhere close to AGI (and I don't think LLMs are sufficient) but also I think OpenAI should get a ton of credit for being the first party to make LLMs that actually useful.
mupuff1234 2y ago
How exactly is the world so much better with GPT 4? I'm not saying it's not cool tech or that the current level of LLMs don't have some impact, but "the world is so much better" is quite a stretch (unless you are a Nvidia shareholder) Not to mention the adverse affect of job loss in industries such as customer service almost exclusively hurting people from poorer countries and lower socio economic levels.
- rabbits77 2y ago
  Yeah, I mean I work inside a Fortune 10 company and after countless man hours across multiple teams we have exactly zero LLM applications in production and the pipeline heading to production is empty. I guess it’s good at generating plausible blog spam and helping children with homework. I’ve used it to bootstrap my own writing. It’s not entirely useless but hardly world changing. I think the biggest commercial use right now is Klarna uses it for basic lvl 1 support? I don’t know the details but it sounds like a good result from RAG over a fairly constrained corpus. So, again, nice but completely unaligned with the massive valuations in that space right now.
  - deleted 2y ago
    [deleted]
__loam 2y ago
I disagree strongly with this. GPT has: - Precipitated a new class of computationally intense and expensive systems at a time when we desperately need to be focused on sustainability and reducing power demands/increasing efficiency. - Devalued human labor without being high enough quality to truly replace it. - Grossly violated an unspoken social contract of the internet by abusing the commons, leading to many people locking down their content. - Flooded the internet with unverifiable noise that looks credible, making it harder to find high quality information and enabling scams and laziness. At best this productivity tool is of neutral value to society. If you think it's a net good, I question your judgment.
- fastball 2y ago
  - No, we just need better ways to generate electricity, which Sam Altman is also working on. - If something is not replacing labor, it will not devalue it. In this case, GPT4 is replacing human labor, which is indeed devaluing those specific labors. But it is also unlocking new potential, which in the history of all technology has always been a net positive in the end. - I wasn't aware of this unspoken social contract before OpenAI existed, but maybe I'm just ignorant. - This is true, but this is also a trend that has been headed downward for a long time thanks to Google/SEO. The signal-to-noise ratio has indeed gone down due to GPT-powered blog spam, but honestly we needed to get our act together before GenAI anyway. This is actually lighting a fire under people's butts to find ways to avoid the AdSense/affiliate marketing fueled drivel.
  - __loam 2y ago
    Oh good, I'm glad Sam Altman, who doesn't even have a bachelor's degree, is on the case. I'm sure his efforts towards cold fusion will be appreciated. > I wasn't aware of this unspoken social contract before OpenAI existed, but maybe I'm just ignorant. It's shocking to me the number of programmers out there who simply did not realize everyone would be mad at them for leveraging everyone's work into a massive for profit system. Then they play stupid when people rightly called them out and spout some bullshit about outmoded forms of production as if productivity was an issue for the generation of culture.
deadbabe 2y ago
GPT-4 is peak LLM, nothing will likely be able to surpass it by these same methods for a long time. The only novel product OpenAI could release at this point is a fully uncensored and unrestrained GPT. Introducing: GPT-ns4w

by invig 2y ago

FlamingMoe 2y ago

So the ends justify the means?

fromMars 2y ago

From what I can tell, all the GPT team did was scale up ideas already there invented elsewhere in previous large language models. I am not sure that is a reason to bet on them making any breakthroughs needed for AGI.

gizmo 2y ago
OpenAI also pioneered reinforcement learning from human feedback (RLHF) to make LLMs output completions that are valuable/relevant. I agree that OpenAI has provided no evidence they are anywhere close to AGI (and I don't think LLMs are sufficient) but also I think OpenAI should get a ton of credit for being the first party to make LLMs that actually useful.

mupuff1234 2y ago

How exactly is the world so much better with GPT 4? I'm not saying it's not cool tech or that the current level of LLMs don't have some impact, but "the world is so much better" is quite a stretch (unless you are a Nvidia shareholder) Not to mention the adverse affect of job loss in industries such as customer service almost exclusively hurting people from poorer countries and lower socio economic levels.

rabbits77 2y ago
Yeah, I mean I work inside a Fortune 10 company and after countless man hours across multiple teams we have exactly zero LLM applications in production and the pipeline heading to production is empty. I guess it’s good at generating plausible blog spam and helping children with homework. I’ve used it to bootstrap my own writing. It’s not entirely useless but hardly world changing. I think the biggest commercial use right now is Klarna uses it for basic lvl 1 support? I don’t know the details but it sounds like a good result from RAG over a fairly constrained corpus. So, again, nice but completely unaligned with the massive valuations in that space right now.
- deleted 2y ago
  [deleted]

__loam 2y ago

I disagree strongly with this. GPT has: - Precipitated a new class of computationally intense and expensive systems at a time when we desperately need to be focused on sustainability and reducing power demands/increasing efficiency. - Devalued human labor without being high enough quality to truly replace it. - Grossly violated an unspoken social contract of the internet by abusing the commons, leading to many people locking down their content. - Flooded the internet with unverifiable noise that looks credible, making it harder to find high quality information and enabling scams and laziness. At best this productivity tool is of neutral value to society. If you think it's a net good, I question your judgment.

fastball 2y ago
- No, we just need better ways to generate electricity, which Sam Altman is also working on. - If something is not replacing labor, it will not devalue it. In this case, GPT4 is replacing human labor, which is indeed devaluing those specific labors. But it is also unlocking new potential, which in the history of all technology has always been a net positive in the end. - I wasn't aware of this unspoken social contract before OpenAI existed, but maybe I'm just ignorant. - This is true, but this is also a trend that has been headed downward for a long time thanks to Google/SEO. The signal-to-noise ratio has indeed gone down due to GPT-powered blog spam, but honestly we needed to get our act together before GenAI anyway. This is actually lighting a fire under people's butts to find ways to avoid the AdSense/affiliate marketing fueled drivel.
- __loam 2y ago
  Oh good, I'm glad Sam Altman, who doesn't even have a bachelor's degree, is on the case. I'm sure his efforts towards cold fusion will be appreciated. > I wasn't aware of this unspoken social contract before OpenAI existed, but maybe I'm just ignorant. It's shocking to me the number of programmers out there who simply did not realize everyone would be mad at them for leveraging everyone's work into a massive for profit system. Then they play stupid when people rightly called them out and spout some bullshit about outmoded forms of production as if productivity was an issue for the generation of culture.

deadbabe 2y ago

GPT-4 is peak LLM, nothing will likely be able to surpass it by these same methods for a long time. The only novel product OpenAI could release at this point is a fully uncensored and unrestrained GPT. Introducing: GPT-ns4w