6 ms·
We had a bunch of servers get taken out by this. We were able to failover with backups from the last 12 hours. The incident sounded suspicious from the start,
by crazyjncsu 6y ago
We had a bunch of servers get taken out by this. We were able to failover with backups from the last 12 hours.
The incident sounded suspicious from the start, but the wording “could not control the fire in SBG2” sounds very ominous ... Chernobyl-y even.
And seeing the compactness of the entire facility (https://baxtel.com/data-center/ovh-strasbourg-campus/photos https://baxtel.com/data-center/ovh-strasbourg-campus/photos), it seems an uncontrolled fire could take out all three buildings in short order. I’m very interested in seeing the damage and postmortem from this one.
Also interesting they tout all sorts of sophistication (https://www.ovh.com/world/us/about-us/datacenters.xml https://www.ovh.com/world/us/about-us/datacenters.xml), but no mention of fire suppression
- cpncrunch 6y agoFire extinction is mentioned here: https://us.ovhcloud.com/about/company/security https://us.ovhcloud.com/about/company/security Out of curiosity, which backups are these? Are they OVH backups? I just noticed that our OVH backup server is in the same region as our server (BHS).
- crazyjncsu 6y agoS3 backups. It’s part of this pseudo-cloud orchestrator we wrote for moving around instances of our single-tenant app.
- cpncrunch 6y agoThx. S3 seems to be the best way to go.