7 ms·

That feeling when you open https://console.cloud.google.com https://console.cloud.google.com and see that you don't have your Kubernetes clusters and CloudSQL d

by darkof 7y ago

That feeling when you open https://console.cloud.google.com https://console.cloud.google.com and see that you don't have your Kubernetes clusters and CloudSQL databases, but CTA to create first.

vpontis 7y ago
Gosh, this was so scary... I thought someone had hacked in and deleted everything... I hope they come back. This is still pretty scary
- stnmtn 7y ago
  Same, my Manager called my and said "everything is down". So I wander over to my Firebase console, and there's no database loading. Thank god for twitter, and people also saying that they have the same issue or I would have for sure though we've been hacked. I hope this is a good wake up call for everyone. I know that I'm going to think more about how we do backups and fail-safes
- hanniabu 7y ago
  And here I thought I was having a bad day with Google Play not loading
- jjeaff 7y ago
  Same. I was thinking, oh, my db cluster must be having trouble recovering. Couldn't get any response through kubectl. Logged in to the cloud console and it looks all brand new, like I have no clusters setup at all. Of course, this is 2 weeks after switching everything over from AWS.
- dpau 7y ago
  my vm instances are all still there, can even log in via SSH in the compute engine tab. looks like they got a reboot 15 min ago. just restarted some processes but lost my progress on about 12hrs of computing time, i'm guessing it's going to be hard to get a refund..
  - londons_explore 7y ago
    You'll get a 25 percent refund of all costs for the month if you ask support
- flamingcow 7y ago
  [I am the Cloud SQL tech lead] This is a networking issue, and your data is safe. Cloud SQL stores instance metadata regionally, so it shares a failure domain with the data it describes. When the region is down or inaccessible, instances are missing from the list results, but that doesn't say anything about the instance availability from within region.
  - grumblez 7y ago
    That's good to know. What confuses me is why they're saying "We continue to experience high levels of network congestion in the eastern USA", when I'm in us-west2 (Los Angeles) and none of my CloudSQL instances, nor is my k8s cluster showing up or contactable...
captn3m0 7y ago
Mumbai region here, and GKE seems to be fine. (Accessing it from Bangalore)
electron0zero 7y ago
Have services running in europe-west1, everything loads and working fine for me. looks like europe-west1 is not affected.

by darkof 7y ago

That feeling when you open https://console.cloud.google.com https://console.cloud.google.com and see that you don't have your Kubernetes clusters and CloudSQL databases, but CTA to create first.

vpontis 7y ago

Gosh, this was so scary... I thought someone had hacked in and deleted everything... I hope they come back. This is still pretty scary

stnmtn 7y ago
Same, my Manager called my and said "everything is down". So I wander over to my Firebase console, and there's no database loading. Thank god for twitter, and people also saying that they have the same issue or I would have for sure though we've been hacked. I hope this is a good wake up call for everyone. I know that I'm going to think more about how we do backups and fail-safes
hanniabu 7y ago
And here I thought I was having a bad day with Google Play not loading
jjeaff 7y ago
Same. I was thinking, oh, my db cluster must be having trouble recovering. Couldn't get any response through kubectl. Logged in to the cloud console and it looks all brand new, like I have no clusters setup at all. Of course, this is 2 weeks after switching everything over from AWS.
dpau 7y ago
my vm instances are all still there, can even log in via SSH in the compute engine tab. looks like they got a reboot 15 min ago. just restarted some processes but lost my progress on about 12hrs of computing time, i'm guessing it's going to be hard to get a refund..
- londons_explore 7y ago
  You'll get a 25 percent refund of all costs for the month if you ask support
flamingcow 7y ago
[I am the Cloud SQL tech lead] This is a networking issue, and your data is safe. Cloud SQL stores instance metadata regionally, so it shares a failure domain with the data it describes. When the region is down or inaccessible, instances are missing from the list results, but that doesn't say anything about the instance availability from within region.
- grumblez 7y ago
  That's good to know. What confuses me is why they're saying "We continue to experience high levels of network congestion in the eastern USA", when I'm in us-west2 (Los Angeles) and none of my CloudSQL instances, nor is my k8s cluster showing up or contactable...

captn3m0 7y ago

Mumbai region here, and GKE seems to be fine. (Accessing it from Bangalore)

electron0zero 7y ago

Have services running in europe-west1, everything loads and working fine for me. looks like europe-west1 is not affected.