9 ms·
https://www.latent.space/p/attention-interface https://www.latent.space/p/attention-interface Labs are now post-training models with Harness so that Harness no
by conmod278 24d ago
https://www.latent.space/p/attention-interface https://www.latent.space/p/attention-interface
Labs are now post-training models with Harness so that Harness now gets absorbed into the weights.
- goosejuice 24d agoMy naive intuition is that as harnesses converge on shape and models improve the first party advantage will mostly disappear.
- layer8 24d agoI’d say that harnesses almost by definition are the parts that you want to keep customizable. That won’t get absorbed into the weights.
- datsci_est_2015 24d agoDepends on your product strategy. If you only care about how your model will be used in the context of a harness (perhaps, specifically the harness that you designed), then the incentive is plainly there to optimize the weights within the context of the harness.
- wyre 24d agoWhat is being absorbed into weights is tool usage. It is incredibly counterproductive to train models on a specific harness, when instead it can be trained to reason about the tools that it has available to itself and how to best use those tools to accomplish it's goal. Would you rather hire an engineer that can adopt to your org's prefered tooling, or hire an engineer that can only perform well with their own favorite tools? It's the same thing.
- rpunkfu 24d ago[dead]