5 ms·
I agree that if you have the weights you can use/train a model with the same architecture, and that you won't get the exact weights on your own due to randomnes
by FinchNova12 2mo ago
I agree that if you have the weights you can use/train a model with the same architecture, and that you won't get the exact weights on your own due to randomness. But isn't data an extremely important part of your ability to effectively train/finetune? It might be much harder to get close to the level of the open weight model if you don't have the data that made it, which is why I think the open weights vs open source distinction is useful.
- nl 2mo agoYou fine-tune the open-weight model without access to the original weights. If you want to train it from scratch you need data, yes. But presumably if you are doing that there is a reason you want to do it. You lose nothing without access to the original data - you can do every single modification without it. That is unlike open source where you (mostly) need to source code to modify it beyond what the original designed originally thought.