6 ms·

I don't find it jaw-dropping because the idea is quite simple. Just feed the model an enormous amount of unethically sourced data, build data centers that cause

I don't find it jaw-dropping because the idea is quite simple. Just feed the model an enormous amount of unethically sourced data, build data centers that cause droughts, and use all chips available so that normal people can't afford to buy RAM anymore. We're all sacrificing great things in order to make these models more capable. Whether it'll all be worth it, only time will tell.

makaking 2mo ago
The arguably sketchy means used to get there —and the resulting side-effects— do not take away from the impressiveness of the emerging capabilities themselves. I agree about the uncertainty regarding the value for humanity in the long-term. But that's not my point. Being jaw-dropped != being happy and cheering for it.
- brokegrammer 2mo ago
  It's certainly a great thing that AI is improving (I use AI to write code daily myself), but I wouldn't be calling it impressive because it's essentially all about money and government backing. At some point, the chickens are gonna come out.
  - breppp 2mo ago
    I am still impressed by the fact we have found a way to feed data to matter and get human surpassing intelligence, that's a very unexpected advance
    - simonbarker87 2mo ago
      It’s not human surpassing intelligence though in my opinion. If we had the same constraints on that task then we would also come up with the idea of creating our own viewer and if, like the LLM, the knowledge to do so was embedded in our brain we would do it, it would just take longer because we can’t type as fast. So instead we would buy or compile a viewer since the problem is already solved.
      - varjag 2mo ago
        IDK the models definitely do write qualitatively better prose (and better code) than the majority of people. If your definition of "human intelligence" is baseline performance of 0.2% of humanity it's certainly something else.
        mistercheph 2mo ago
        they don't, cite one example of well written LLM prose? they can definitely infer a lot more slop than people have patience to, and anyone writing or reading slop prose has realised this and replaced sitting around writing and reading slop wiith llm's writing and reading slop and then grug-brains paste 10k words of slop say "grok, pls summarize, no mistakes" and grok tells them "What a brilliantly written article! ... "
        varjag 2mo ago
        Have you ever received an email from trades folk, in the days before LLMs? I'm not saying it's a better writer than Hemingway but very likely better than most your classmates.
        mistercheph 1mo ago
        Yes, and I'm saying that generating predictable slop is totally free now, humans behaving like machines turns out to be replaceable by machines.
        skydhash 2mo ago
        Better code and better prose are not great indicators of intelligence. Can it help you survive in the middle of the jungle? Can it grow rice? Can it give you first aid? Intelligence is the ability to learn skills and adapt them to the situation. The importance of skills is contextual. Better prose and code is just education, not intelligence.
        varjag 2mo ago
  - ddalex 2mo ago
    > At some point, the chickens are gonna come out. What does this mean ? AI will only get better and cheaper. > essentially all about money and government backing So is nuclear power, and once it came it didn't go away.
    - brokegrammer 2mo ago
      AI is cheap right now thanks to governments or VCs agreeing to lose money. I can use DeepSeek to code all day thanks to the CCP. Nuclear power benefits everyone. Who does AI benefit apart from a few vibe coders and a small amount of knowledge workers?
- watwut 2mo ago
  We have certainity it will be used to harm most people in the short term while pointificating about long term future. CEO class is very open with their vision and goals, none of them spell anything positive for us.
  - brokegrammer 2mo ago
    Exactly. I'm a nerd too and we nerds can real hypocrites because we spend too much time alone. I will happily turn a blind eye to world suffering if it means I get to work less but get paid the same. AI CEOs aren't different. At some point we'll have to admit that we're sacrificing others for our own benefit.
  - derektank 2mo ago
    >We have certainity it will be used to harm most people in the short term How will it harm most people in the short term, exactly?
    - Grombobulous 2mo ago
      Taking jobs away, obviously. And the only reason no longer working is a bad thing is that nobody trusts our government to create a universal welfare system.
      - derektank 2mo ago
        It seems very unlikely to me that most people will lose either their current job in the short term, or their ability to find work at all in the medium term. It does seem like something to worry about for a small percentage of people in the short term (just as the China shock hurt a number of manufacturing workers in the 90s/00s) and maybe a majority of people when AGI exists, but who knows when that will be.
        Grombobulous 2mo ago
        Sure, though I think you can understand how most laypeople don’t really feel like the risks are worth the reward. The people at the top are guaranteed to benefit. The people at the bottom probably figure they have a very low chance of benefiting.
9dev 2mo ago
Then again, looking back, that’s the way history is made. Modern democracies in the west are built on foundations of slavery and colonialism; yet we cherish them as to all the greatness they have brought as well. We need some amount of tolerance to ambiguity, and LLMs are undoubtedly both extremely cool but also extremely concerning. Edit: Note that I am not saying that this is good, or desirable; just that it is. The technology is here know and not going anywhere, with all the flaws of its conception. We can be skeptical and curious at the same time.
- brokegrammer 2mo ago
  The west thrived by leveraging slavery and colonialism at the expense of everyone else. Then democracies were built by moving away from both slavery and colonialism so that the world can grow as a whole. It's possible that we'll have to move away from AI at some point in order for society to continue growing.
  - alex43578 2mo ago
    Please tell me you're not so delusional to think that slavery or colonialism is a uniquely "western" trait. Empires, nation-states, and groups all sought to expand; some, for various reasons, did much better than others.
  - Shorel 2mo ago
    The ottoman empire leveraged slavery and colonialism just as much, and there's no progress to be seen from them, at least not when compared to the west. It's the renaissance and the scientific and industrial revolutions, that's what gave the west the opportunity to thrive.
    - brokegrammer 2mo ago
      Unlike western powers, The Ottoman empire didn't use slavery and colonialism to create capital. Instead, it wanted slaves so that it could grow its military. The west also made its goal to create a new world order while the Ottoman empire's goal was mostly revenue extraction. The British systematically deindustrialized India’s textile sector to turn it from a competitor into an exporter of raw cotton and an importer of Lancashire cloth. The Ottoman would opt for taxation instead of usurpation of an entire industry. Scientific revolutions was already happening during the bronze age. The west simply leveraged existing systems while making use of violence and exploitation to rise to the top.
schnebbau 2mo ago
> We're all sacrificing great things Oh please. > Unethically sourced data Is that a great sacrifice? > data centers that cause droughts That's nonsense. > normal people can't afford to buy RAM anymore Lol? Another great sacrifice? This isn't a healthy or sensible way to think.
- d0mine 2mo ago
  How about total surveillance total thought control total power in a hands of few trillionaires in the near future. Drones killing undesirables with cheering crowds watching. It is not like it is much different right now but it may be significantly worse. And even that is one of the “good” outcomes assuming no ASI.
  - Marha01 2mo ago
    That is a bad outcome. But there are better possible outcomes that the doomers ignore. How about AI curing cancer? I think that alone is worth the risks.
    - brokegrammer 2mo ago
      By the time we spend all the earths resources to train AI models so that cancer is cured, we could have spent those same resources training real humans. The literacy rate of undeveloped countries is still abysmal. We could train more people and fund more research. And humans can keep growing while AI can only grow if it has access to high quality training data. Who provides the data? Humans.

makaking 2mo ago

The arguably sketchy means used to get there —and the resulting side-effects— do not take away from the impressiveness of the emerging capabilities themselves. I agree about the uncertainty regarding the value for humanity in the long-term. But that's not my point. Being jaw-dropped != being happy and cheering for it.

brokegrammer 2mo ago
It's certainly a great thing that AI is improving (I use AI to write code daily myself), but I wouldn't be calling it impressive because it's essentially all about money and government backing. At some point, the chickens are gonna come out.
- breppp 2mo ago
  I am still impressed by the fact we have found a way to feed data to matter and get human surpassing intelligence, that's a very unexpected advance
  - simonbarker87 2mo ago
    It’s not human surpassing intelligence though in my opinion. If we had the same constraints on that task then we would also come up with the idea of creating our own viewer and if, like the LLM, the knowledge to do so was embedded in our brain we would do it, it would just take longer because we can’t type as fast. So instead we would buy or compile a viewer since the problem is already solved.
    - varjag 2mo ago
      IDK the models definitely do write qualitatively better prose (and better code) than the majority of people. If your definition of "human intelligence" is baseline performance of 0.2% of humanity it's certainly something else.
      - mistercheph 2mo ago
        they don't, cite one example of well written LLM prose? they can definitely infer a lot more slop than people have patience to, and anyone writing or reading slop prose has realised this and replaced sitting around writing and reading slop wiith llm's writing and reading slop and then grug-brains paste 10k words of slop say "grok, pls summarize, no mistakes" and grok tells them "What a brilliantly written article! ... "
        varjag 2mo ago
        Have you ever received an email from trades folk, in the days before LLMs? I'm not saying it's a better writer than Hemingway but very likely better than most your classmates.
        mistercheph 1mo ago
        Yes, and I'm saying that generating predictable slop is totally free now, humans behaving like machines turns out to be replaceable by machines.
      - skydhash 2mo ago
        Better code and better prose are not great indicators of intelligence. Can it help you survive in the middle of the jungle? Can it grow rice? Can it give you first aid? Intelligence is the ability to learn skills and adapt them to the situation. The importance of skills is contextual. Better prose and code is just education, not intelligence.
        varjag 2mo ago
- ddalex 2mo ago
  > At some point, the chickens are gonna come out. What does this mean ? AI will only get better and cheaper. > essentially all about money and government backing So is nuclear power, and once it came it didn't go away.
  - brokegrammer 2mo ago
    AI is cheap right now thanks to governments or VCs agreeing to lose money. I can use DeepSeek to code all day thanks to the CCP. Nuclear power benefits everyone. Who does AI benefit apart from a few vibe coders and a small amount of knowledge workers?
watwut 2mo ago
We have certainity it will be used to harm most people in the short term while pointificating about long term future. CEO class is very open with their vision and goals, none of them spell anything positive for us.
- brokegrammer 2mo ago
  Exactly. I'm a nerd too and we nerds can real hypocrites because we spend too much time alone. I will happily turn a blind eye to world suffering if it means I get to work less but get paid the same. AI CEOs aren't different. At some point we'll have to admit that we're sacrificing others for our own benefit.
- derektank 2mo ago
  >We have certainity it will be used to harm most people in the short term How will it harm most people in the short term, exactly?
  - Grombobulous 2mo ago
    Taking jobs away, obviously. And the only reason no longer working is a bad thing is that nobody trusts our government to create a universal welfare system.
    - derektank 2mo ago
      It seems very unlikely to me that most people will lose either their current job in the short term, or their ability to find work at all in the medium term. It does seem like something to worry about for a small percentage of people in the short term (just as the China shock hurt a number of manufacturing workers in the 90s/00s) and maybe a majority of people when AGI exists, but who knows when that will be.
      - Grombobulous 2mo ago
        Sure, though I think you can understand how most laypeople don’t really feel like the risks are worth the reward. The people at the top are guaranteed to benefit. The people at the bottom probably figure they have a very low chance of benefiting.

9dev 2mo ago

Then again, looking back, that’s the way history is made. Modern democracies in the west are built on foundations of slavery and colonialism; yet we cherish them as to all the greatness they have brought as well. We need some amount of tolerance to ambiguity, and LLMs are undoubtedly both extremely cool but also extremely concerning. Edit: Note that I am not saying that this is good, or desirable; just that it is. The technology is here know and not going anywhere, with all the flaws of its conception. We can be skeptical and curious at the same time.

brokegrammer 2mo ago
The west thrived by leveraging slavery and colonialism at the expense of everyone else. Then democracies were built by moving away from both slavery and colonialism so that the world can grow as a whole. It's possible that we'll have to move away from AI at some point in order for society to continue growing.
- alex43578 2mo ago
  Please tell me you're not so delusional to think that slavery or colonialism is a uniquely "western" trait. Empires, nation-states, and groups all sought to expand; some, for various reasons, did much better than others.
- Shorel 2mo ago
  The ottoman empire leveraged slavery and colonialism just as much, and there's no progress to be seen from them, at least not when compared to the west. It's the renaissance and the scientific and industrial revolutions, that's what gave the west the opportunity to thrive.
  - brokegrammer 2mo ago
    Unlike western powers, The Ottoman empire didn't use slavery and colonialism to create capital. Instead, it wanted slaves so that it could grow its military. The west also made its goal to create a new world order while the Ottoman empire's goal was mostly revenue extraction. The British systematically deindustrialized India’s textile sector to turn it from a competitor into an exporter of raw cotton and an importer of Lancashire cloth. The Ottoman would opt for taxation instead of usurpation of an entire industry. Scientific revolutions was already happening during the bronze age. The west simply leveraged existing systems while making use of violence and exploitation to rise to the top.

schnebbau 2mo ago

> We're all sacrificing great things Oh please. > Unethically sourced data Is that a great sacrifice? > data centers that cause droughts That's nonsense. > normal people can't afford to buy RAM anymore Lol? Another great sacrifice? This isn't a healthy or sensible way to think.

d0mine 2mo ago
How about total surveillance total thought control total power in a hands of few trillionaires in the near future. Drones killing undesirables with cheering crowds watching. It is not like it is much different right now but it may be significantly worse. And even that is one of the “good” outcomes assuming no ASI.
- Marha01 2mo ago
  That is a bad outcome. But there are better possible outcomes that the doomers ignore. How about AI curing cancer? I think that alone is worth the risks.
  - brokegrammer 2mo ago
    By the time we spend all the earths resources to train AI models so that cancer is cured, we could have spent those same resources training real humans. The literacy rate of undeveloped countries is still abysmal. We could train more people and fund more research. And humans can keep growing while AI can only grow if it has access to high quality training data. Who provides the data? Humans.