6 ms·
I think a cheat code here is to route your requests to GCP's Vertex AI, which has stronger uptimes. Can use it as a fallback or main provider. Caveats: 1) May
by jwithington 5mo ago
I think a cheat code here is to route your requests to GCP's Vertex AI, which has stronger uptimes. Can use it as a fallback or main provider.
Caveats: 1) May not be economic for those on flat-rate Anthropic subscription plans 2) I work at Google.
- scratchyone 5mo agodoes google actually host anthropic models themselves?? surprised anthropic allows that, given how notoriously crazy they are about distillation or weight leaks or any hints of their models being used in the wrong way.
- jwithington 5mo agoYes, we host it ourselves, acting as the data processor which can be important for enterprise customers. From developer experience, hosting them ourselves allows us to take advantage of our unique infra and deliver fastest time to first tokens of the providers.