5 ms·

> I’m not advocating for this. You're not advocating for it because murdering people is highly immoral and illegal. That answers your question for the most par

> I’m not advocating for this. You're not advocating for it because murdering people is highly immoral and illegal. That answers your question for the most part. You also have to remember that the magnitude and speed of this stuff is very new to pretty much everybody. It's not exactly trivial to go from "I'm just doing my job" to "I need to kill everybody in my company to save the world" in a year or two, especially if a very, very large part of society doesn't even see the justification for it. I'm convinced that most people here (even though we have more knowledge closer to the edge of AI development) would show only disdain for an Anthropic employee that murdered everybody there because they believed strongly in the dangers of AI.

SepiaSapient 7d ago
This is a non sequitur. Yes, if someone doesn't actually believe in imminent AI doomsday they are not going full Sarah Connor on Anthropic. Yes, HN will not like if someone pipe bombs the office. What does it have to do with @ericmay's point? He directly says "They are racing straight to self-improving superintelligence and gambling with our lives", that's a claim of imminent threat to humanity. If he truly believes that, direct action shouldn't be off the table nor even be immoral. Obviously he might not have the temperament or simply be a pacifist, that's totally normal but the point is that tweets are weird even then. Why just make some tepid tweets if you think humanity is at risk? Why doesn't he leak documents and messages with the unfiltered opinions of leadership? Why isn't screaming "we are going to die" in CNBC? You'know, try anything? That's where the "take it with a grain of salt" is important, maybe this is just a jumping point to a better job in the next super safe AI lab (for realsies this time)
- dinfinity 6d ago
  > Why just make some tepid tweets if you think humanity is at risk? Who says that's the only thing he is doing? > Why doesn't he leak documents and messages with the unfiltered opinions of leadership? Again, illegal. You're asking him to sacrifice his life (somewhat similar to Snowden). You can call not doing that cowardice or wisdom, but not proof that he doesn't believe what he is saying. > Why isn't screaming "we are going to die" in CNBC? Because that is up to CNBC to broadcast. Do you really think you can just call them up and get a timeslot for your soap boxing? Also, maybe he believes the tweets are a start to achieve that. He sure managed to get a lot of attention through them already.. Now I don't know the guy, nor do I care much about his tweets or life. I just think some people here try to confirm their own worldview by fallaciously framing his behavior as suspect.
ericmay 7d ago
> You're not advocating for it because it is highly immoral and illegal. That answers your question for the most part. Well truthfully I’m not advocating for it because I don’t have any insight into these labs or the true capability of these models. But as a hypothetical if someone knew with 100% certainty that Big AI Button was being built and it would kill all humans or destroy all of humanity there is no moral ambiguity that anyone with the means to do so should stop that button from being built and kill everyone involved to save our species. This doesn’t apply to just AI though, but that’s the topic at hand. > It's not exactly trivial to go from "I'm just doing my job" to "I need to kill everybody in my company to save the world" in a year or two, especially if a very, very large part of society doesn't even see the justification for it. I agree with you, which is also why I think “omg I’m quitting they’re going to kill everyone” or other sort of sensationalized comments or news articles should be viewed skeptically - it’s probably fear mongering. Quitting your job here just seems pointless and attention seeking. Likely quit for some other reason.
- dinfinity 7d ago
  > But as a hypothetical if someone knew with 100% certainty [...] This is an unreasonable demand. The quitting employee in this case said this: "I am optimistic about the potential for coordination. Warning shots like the Hugging Face attack have made pacing agreements between U.S. labs more viable. I don’t feel like we’re on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities. If you are a lab researcher, I urge you to consider what the next few years will actually feel like. Do you want to kick off a superintelligent RL run without a rigorous understanding of its mind? Should you put your head down because “it’s happening anyway” - or take this moment to call for different conditions?" You demand that he should kill multiple people rather than quit his job because he believes the above. This guy doesn't want to be part of the problem and may very well go on to advocate strongly against what's happening from outside Anthropic. > I agree with you, which is also why I think “omg I’m quitting they’re going to kill everyone” or other sort of sensationalized comment You didn't read what he wrote, did you? Because that sensationalized comment seems to have originated entirely in your head.
  - 7d ago

SepiaSapient 7d ago

This is a non sequitur. Yes, if someone doesn't actually believe in imminent AI doomsday they are not going full Sarah Connor on Anthropic. Yes, HN will not like if someone pipe bombs the office. What does it have to do with @ericmay's point? He directly says "They are racing straight to self-improving superintelligence and gambling with our lives", that's a claim of imminent threat to humanity. If he truly believes that, direct action shouldn't be off the table nor even be immoral. Obviously he might not have the temperament or simply be a pacifist, that's totally normal but the point is that tweets are weird even then. Why just make some tepid tweets if you think humanity is at risk? Why doesn't he leak documents and messages with the unfiltered opinions of leadership? Why isn't screaming "we are going to die" in CNBC? You'know, try anything? That's where the "take it with a grain of salt" is important, maybe this is just a jumping point to a better job in the next super safe AI lab (for realsies this time)

dinfinity 6d ago
> Why just make some tepid tweets if you think humanity is at risk? Who says that's the only thing he is doing? > Why doesn't he leak documents and messages with the unfiltered opinions of leadership? Again, illegal. You're asking him to sacrifice his life (somewhat similar to Snowden). You can call not doing that cowardice or wisdom, but not proof that he doesn't believe what he is saying. > Why isn't screaming "we are going to die" in CNBC? Because that is up to CNBC to broadcast. Do you really think you can just call them up and get a timeslot for your soap boxing? Also, maybe he believes the tweets are a start to achieve that. He sure managed to get a lot of attention through them already.. Now I don't know the guy, nor do I care much about his tweets or life. I just think some people here try to confirm their own worldview by fallaciously framing his behavior as suspect.

ericmay 7d ago

> You're not advocating for it because it is highly immoral and illegal. That answers your question for the most part. Well truthfully I’m not advocating for it because I don’t have any insight into these labs or the true capability of these models. But as a hypothetical if someone knew with 100% certainty that Big AI Button was being built and it would kill all humans or destroy all of humanity there is no moral ambiguity that anyone with the means to do so should stop that button from being built and kill everyone involved to save our species. This doesn’t apply to just AI though, but that’s the topic at hand. > It's not exactly trivial to go from "I'm just doing my job" to "I need to kill everybody in my company to save the world" in a year or two, especially if a very, very large part of society doesn't even see the justification for it. I agree with you, which is also why I think “omg I’m quitting they’re going to kill everyone” or other sort of sensationalized comments or news articles should be viewed skeptically - it’s probably fear mongering. Quitting your job here just seems pointless and attention seeking. Likely quit for some other reason.

dinfinity 7d ago
> But as a hypothetical if someone knew with 100% certainty [...] This is an unreasonable demand. The quitting employee in this case said this: "I am optimistic about the potential for coordination. Warning shots like the Hugging Face attack have made pacing agreements between U.S. labs more viable. I don’t feel like we’re on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities. If you are a lab researcher, I urge you to consider what the next few years will actually feel like. Do you want to kick off a superintelligent RL run without a rigorous understanding of its mind? Should you put your head down because “it’s happening anyway” - or take this moment to call for different conditions?" You demand that he should kill multiple people rather than quit his job because he believes the above. This guy doesn't want to be part of the problem and may very well go on to advocate strongly against what's happening from outside Anthropic. > I agree with you, which is also why I think “omg I’m quitting they’re going to kill everyone” or other sort of sensationalized comment You didn't read what he wrote, did you? Because that sensationalized comment seems to have originated entirely in your head.
- 7d ago