5 ms·
Author here. It's a law, so nobody has to agree to anything. If want to sell access to a model, you have to open the weights. It's Dario's plan that depends o
by jacobgold 4d ago
Author here.
It's a law, so nobody has to agree to anything. If want to sell access to a model, you have to open the weights.
It's Dario's plan that depends on every lab in the world agreeing.
Step #2 of his essay is "democratic coordination" among frontier labs and step three is coordination with China. I'm suggesting a single law Congress could pass that every US model company would have to follow on the same day, whether they like it or not.
Frontier progress is compute bound. Compute is bought with investor money. Investors put up tens of billions because they expect to sell the proprietary model that is created.
You're welcome to think the effect would be smaller than I do. But "it requires everyone to agree" is backwards.
- vorticalbox 4d agoWon’t the companies just change what they are selling from access to the model to “compute” and then not technically be breaking the law?
- linkregister 4d agoIf you're proposing a law that would not be in Dario's best interest, why address the post to him?
- jacobgold 4d agoI explained this in the post. He seems like a genuinely good person who might actually do something this great.
- hypfer 4d agoDude this site is so funny at times. Incredible. Yes, why would you ever address someone with something that is not in their best interest. Especially people that have power. I agree. We should never do that and let them just live in peace and do their thing.
- Balinares 3d agoHe sells himself as an ethical guy, and doing things that are broadly positive for everyone even if they're against your own personal self-interest is basic ethicality.
- Aurornis 4d ago> It's a law, so nobody has to agree to anything. If want to sell access to a model, you have to open the weights. Laws don’t extend to the entire world. There are AI labs outside of the US that are not that far behind. Forcing US companies to open their weights would hand those labs another advantage, moving the frontier AI to a location outside of any US regulation. Your proposal doesn’t make any sense. > The plan that depends on every lab in the world agreeing is Dario's. I don’t understand how you think creating a law in the US to destroy our AI companies and give an advantage to competitors we can’t regulate accomplishes anything in line with the AI safety debate.
- jacobgold 4d agoLaws don't extend to the whole world, but markets do. The law should apply to anyone selling model access to Americans, the same way GDPR applies to US companies selling to Europeans. Frontier development won't simply move offshore because the GPUs, most of the people, and almost all of the funding is here. Our European and Asian allies would probably go along with this idea, because it costs us far more than it costs them.
- CamperBob2 4d ago[dead]
- Aurornis 4d ago> The law should apply to anyone selling model access to Americans So the US AI labs get taken out, and US companies fall behind on access, too? This is beyond unrealistic. > Our European and Asian allies would probably go along with this idea I could see European countries doing it. Asian - absolutely no way that would happen.
- jacobgold 4d agoNobody gets taken out. Anthropic and OpenAI can keep selling inference, products, and agents. Every company will have more access than it has today, since it can run the weights itself or through third-parties. Many of them would keep paying OpenAI and Anthropic, at reduced pricing/margins. It would only slow down the development of new models. But we've already got models with massive "capability overhang" that we could keep pushing for years.
- andai 4d ago> It's a law, so nobody has to agree to anything. Step 1, form a world government?
- jacobgold 4d agoWe can start with a US law. It would cover AI model companies with almost all the money and the GPUs, which is most of the frontier. We can also probably convince our allies, which combined represents most of the world market.
- andai 4d ago"Make your country the last to get nukes" is a bit of a hard sell.
- ucyo 4d agoHow do you enforce this though? How do you prevent any citizen from using foreign services eg using a VPN? Just asking for a friend (“shut up Netflix, I already asked”)
- reverius42 4d agoThe argument seems to be: * Destroy the free internet in the US, ban VPNs in the US, assume enforcement of this is effective, ban frontier AI development in the US (probably needs at least one constitutional amendment) * Assume no other countries will continue to develop AI and approach or push the frontier * Then, the frontier ceases to move until the US companies agree to let it move again ... I don't think anyone proposing a "pause" has studied politics or game theory even at a high school level.