8 ms·
Strange way to structure an argument. He seems to be arguing in favor of local models, but most of his examples are reasons local models are bad.
by medler 2mo ago
Strange way to structure an argument. He seems to be arguing in favor of local models, but most of his examples are reasons local models are bad.
- drdaeman 2mo agoHow’s that “skipping vendor bloatware to get the printer working” example is bad? Once upon a time that situation got us the whole Free Software movement going.
- medler 2mo agoThat’s the one out of three that’s not bad
- operatingthetan 2mo agoIf you follow his recent posts he's on a bit of a spiral with how he thinks about AI.
- charcircuit 2mo agoLocal models and alignment are orthogonal concepts.
- vntok 2mo agoHow so? If it's not local, it's not yours, a third party owns it. Why would you expect that third party specifically trained their model to be more aligned to you and your needs than to them and their (business) needs?
- charcircuit 2mo ago>Why would you expect that third party specifically trained their model to be more aligned to you and your needs than to them and their (business) needs? That is my point. Why do you think Gemma, a local model trained by Google, is aligned to you and not the values of Google. You can similarly have a model aligned to you which you pay someone to remotely host for you instead of running it locally.
- bloaf 2mo agoI don't think this is entirely true, insofar as non-local models inherently have a "man cannot serve two masters" problem. The end user and the org running the AI may have different goals. That means even if AI alignment were to be in some sense "solved" for local models, you wouldn't be guaranteed an aligned AI using a non-local model because the "owners" of the non-local model may have deliberately misaligned the AI in their favor and against your interests.
- charcircuit 2mo agoThink of AWS. If you break their ToS and host a pirate website there it will work despite being misaligned from AWS. You are that sole master of the software. AWS is the sole master of the "hardware." Now ultimately hardware has control over the software so technically AWS could just hack into whatever code you are running and do what they want, but in practice they act solely as the master of the hardware and will tell the hardware to "shut down" if they catch you acting out of their alignment. With local models just because you are providing the compute, that doesn't mean you are the master of the model and it is aligned to your interests. You could just be subsidizing inference for a model aligned to someone else.
- medler 2mo agoTake it up with geohot