7 ms·

You can just map them all... I have. I also worked at AWS :)

chatmasta 3y ago
This would be an interesting dataset to use for trading decisions (or sell to hedge funds). But I wonder how much of their infrastructure is publicly mappable, compared to just the part of it that's exposed to the edge. (Can you map some internal instances in a VPC?) That said, I'm sure there are a lot of side channels in the provisioning APIs, certificate logs, and other metadata that could paint a decently accurate picture of cloud sizes. It might not cover everything but it'd be good enough to track and measure a gradual expansion of capacity.
- virtuallynathan 3y ago
  I’m not sure mapping VPCs is super helpful - the physical infra is fairly distinct. AWS has also disclosed 20 million Nitro adapters have been deployed, so you can do some backwards napkin math from that.
the-rc 3y ago
Mapping as in.. drawing the outlines of buildings and computing the square footage yourself?
- virtuallynathan 3y ago
  Yep.
  - the-rc 3y ago
    Then you should be aware that, for the longest time, Google was against multiple floors, until they suddenly switched to four floors in many locations: https://www.datacenterfrontier.com/cloud/article/11431213/scaling-up-google-building-four-story-data-centers https://www.datacenterfrontier.com/cloud/article/11431213/sc... A decade ago, there was a burst in construction and in some places the bottleneck was not getting the machines or electricity, but how fast they could deliver and pour cement, even working overnight.
    - virtuallynathan 3y ago
      Yep, I am aware, I have a square footage multiplier for their multi-story buildings.
      - jedberg 3y ago
        But how can you know how many floors they have? And where are you getting the list of buildings from? And what makes you think your list is complete? Also how do you know their efficiency? Google might have less space but also a way to pack twice as much compute in the same place. Like I said, this is impossible to know without a lot of insider information from a lot of companies.
        virtuallynathan 3y ago
        Well, they tell you for one: https://datacenterpost.com/scaling-up-google-building-four-story-data-centers/ https://datacenterpost.com/scaling-up-google-building-four-s... We also have Google Street view, etc. Of course, it's all estimates. You can get fancier and count generators and transformers and stuff too.

This would be an interesting dataset to use for trading decisions (or sell to hedge funds). But I wonder how much of their infrastructure is publicly mappable, compared to just the part of it that's exposed to the edge. (Can you map some internal instances in a VPC?) That said, I'm sure there are a lot of side channels in the provisioning APIs, certificate logs, and other metadata that could paint a decently accurate picture of cloud sizes. It might not cover everything but it'd be good enough to track and measure a gradual expansion of capacity.

virtuallynathan 3y ago
I’m not sure mapping VPCs is super helpful - the physical infra is fairly distinct. AWS has also disclosed 20 million Nitro adapters have been deployed, so you can do some backwards napkin math from that.

the-rc 3y ago

Mapping as in.. drawing the outlines of buildings and computing the square footage yourself?

virtuallynathan 3y ago
Yep.
- the-rc 3y ago
  Then you should be aware that, for the longest time, Google was against multiple floors, until they suddenly switched to four floors in many locations: https://www.datacenterfrontier.com/cloud/article/11431213/scaling-up-google-building-four-story-data-centers https://www.datacenterfrontier.com/cloud/article/11431213/sc... A decade ago, there was a burst in construction and in some places the bottleneck was not getting the machines or electricity, but how fast they could deliver and pour cement, even working overnight.
  - virtuallynathan 3y ago
    Yep, I am aware, I have a square footage multiplier for their multi-story buildings.
    - jedberg 3y ago
      But how can you know how many floors they have? And where are you getting the list of buildings from? And what makes you think your list is complete? Also how do you know their efficiency? Google might have less space but also a way to pack twice as much compute in the same place. Like I said, this is impossible to know without a lot of insider information from a lot of companies.
      - virtuallynathan 3y ago
        Well, they tell you for one: https://datacenterpost.com/scaling-up-google-building-four-story-data-centers/ https://datacenterpost.com/scaling-up-google-building-four-s... We also have Google Street view, etc. Of course, it's all estimates. You can get fancier and count generators and transformers and stuff too.