8 ms·
Is this testing for spot instances? In my limited experience, persistent (on-demand) GCP instances always boot up much faster than AWS EC2 instances.
by devxpy 4y ago
Is this testing for spot instances?
In my limited experience, persistent (on-demand) GCP instances always boot up much faster than AWS EC2 instances.
- marcinzm 4y agoIn my experience GPU persistent instances often simply don't boot up on GCP due to lack of available GPUs. One reason I didn't choose GCP at my last company.
- devxpy 4y agoOh interesting. Which region and GPU type were you working with? (Asking so I can avoid in future)
- marcinzm 4y agoI think it was us-east1 or us-east4. Had issues getting TPUs as well in us-central1. I know someone at a larger tech company who was told to only run certain workflows in a specific niche European region as that's the only one that had any A100 GPUs most of the time.
- encryptluks2 4y agoI noticed that too and it does appear to be using spot instances. I have a feeling if it was ran without you may see much better startup times. Spot instances on GCP are hit and miss and you sort of have to build that into your workflow.