6 ms·

I think a more interesting article on S3 is "Building and operating a pretty big storage system called S3" https://www.allthingsdistributed.com/2023/07/buildin

I think a more interesting article on S3 is "Building and operating a pretty big storage system called S3" https://www.allthingsdistributed.com/2023/07/building-and-operating-a-pretty-big-storage-system.html https://www.allthingsdistributed.com/2023/07/building-and-op...

giancarlostoro 1y ago
Really nice read, thank you for that.
- enether 1y ago
  Author of the 2minutestreaming blog here. Good point! I'll add this as a reference at the end. I loved that piece. My goal was to be more concise and focus on the HDD aspect
  - pjdesno 1y ago
    Please fix the seek time numbers - they’re wildly in accurate; full platter seek is more like 20-25ms. I tried chasing down where the 8ms number came from a while back, and I think it applies to old sub-100GB 10K RPM high-speed drives from 25 or so years ago, which were purposely low density so they could swing the head faster and less precisely. Check out the Olmez et al paper from MSST 2024 - I linked it above, but here it is again: https://www.msstconference.org/MSST-history/2024/Papers/msst24-1.1.pdf https://www.msstconference.org/MSST-history/2024/Papers/msst...
    - enether 1y ago
      !!! Thanks for calling that out. And sorry for falling prey to the numbers I saw (from the AWS talk) And for the 1/2 vs 1/3rd - I'm just dumb. Thanks again. Super cool paper too
littlesnugblood 1y ago
[flagged]
- gostsamo 1y ago
  Can you share some anecdotes?
- huntaub 1y ago
  Woah buddy, I worked with Andy for years and this is not my experience. Moving a large product like S3 around is really, really difficult, and I've always thought highly of Andy's ability to: (a) predict where he thought the product should go, (b) come up with novel ways of getting there, and (c) trimming down the product to get something in the hands of customers. Also, did you create this account for the express purpose of bashing Andy? That's not cool.
  - Powdering7082 1y ago
    [flagged]
    - wavesbelow 1y ago
      Well, the claim in question is not exactly a rebuttal of the original commenter's point despite the negative tone so I'd cut him some slack
dang 1y ago
Discussed at the time: Building and operating a pretty big storage system called S3 - https://news.ycombinator.com/item?id=36894932 https://news.ycombinator.com/item?id=36894932 - July 2023 (160 comments)

giancarlostoro 1y ago

Really nice read, thank you for that.

enether 1y ago
Author of the 2minutestreaming blog here. Good point! I'll add this as a reference at the end. I loved that piece. My goal was to be more concise and focus on the HDD aspect
- pjdesno 1y ago
  Please fix the seek time numbers - they’re wildly in accurate; full platter seek is more like 20-25ms. I tried chasing down where the 8ms number came from a while back, and I think it applies to old sub-100GB 10K RPM high-speed drives from 25 or so years ago, which were purposely low density so they could swing the head faster and less precisely. Check out the Olmez et al paper from MSST 2024 - I linked it above, but here it is again: https://www.msstconference.org/MSST-history/2024/Papers/msst24-1.1.pdf https://www.msstconference.org/MSST-history/2024/Papers/msst...
  - enether 1y ago
    !!! Thanks for calling that out. And sorry for falling prey to the numbers I saw (from the AWS talk) And for the 1/2 vs 1/3rd - I'm just dumb. Thanks again. Super cool paper too

littlesnugblood 1y ago

[flagged]

gostsamo 1y ago
Can you share some anecdotes?
huntaub 1y ago
Woah buddy, I worked with Andy for years and this is not my experience. Moving a large product like S3 around is really, really difficult, and I've always thought highly of Andy's ability to: (a) predict where he thought the product should go, (b) come up with novel ways of getting there, and (c) trimming down the product to get something in the hands of customers. Also, did you create this account for the express purpose of bashing Andy? That's not cool.
- Powdering7082 1y ago
  [flagged]
  - wavesbelow 1y ago
    Well, the claim in question is not exactly a rebuttal of the original commenter's point despite the negative tone so I'd cut him some slack

dang 1y ago

Discussed at the time: Building and operating a pretty big storage system called S3 - https://news.ycombinator.com/item?id=36894932 https://news.ycombinator.com/item?id=36894932 - July 2023 (160 comments)