8 ms·
Is Bedrock a "middleman?" I believe that they run all inference inside of AWS data centers, on their own infrastructure. Their new endpoint even promises zero
by unreal6 2mo ago
Is Bedrock a "middleman?" I believe that they run all inference inside of AWS data centers, on their own infrastructure.
Their new endpoint even promises zero operator access [0]
[0] https://aws.amazon.com/blogs/machine-learning/exploring-the-zero-operator-access-design-of-mantle/ https://aws.amazon.com/blogs/machine-learning/exploring-the-...
- wmf 2mo agoWeights are worth far more than data centers.
- jimbokun 2mo agoWhy? Seems like open weight models keep catching up to state of the art within a few months, at most. Doesn’t seem like much of a moat to me.
- twoodfin 2mo agoIf/when open-weight models do catch up (i.e. become the dominant product in demand), Amazon transitions from a middle-man to the supplier with the best economies of scale. Great business either way. You could even draw an analogy to Linux/OSS & the origins of AWS. They started as basically an infra middle-man for other people’s technology. But as the core tech commoditized, they transitioned into selling their own higher level services at scale—like Bedrock.
- lelanthran 2mo ago> Weights are worth far more than data centers. I dunno, hey. After all, I can't distill my competitors datacentres :-)
- twoodfin 2mo agoSure, but fundamentally they’re acting as a distributor of someone else’s product in the form of the frontier models. That’s a classic middle-man. No value judgement. I think this is a fantastic strategy.