20 ms·

Both OpenAI and Anthropic have billing caps… who doesn’t?

by a13n 4mo ago

totaa 4mo ago
Google Vertex
- srameshc 4mo ago
  https://aistudio.google.com/spend https://aistudio.google.com/spend ? Monthly spend cap
  - mips_avatar 4mo ago
    I spent two hours the other day trying to figure out how to manage spend on gcp, i gave up and used openrouter and cloudflare.
  - squeaky-clean 4mo ago
    > Long-running tasks like batch mode completions and agent sessions may incur overages beyond your project spend cap. > Billing data processing times can be delayed in AI Studio, up to around 10 minutes. You may experience overages beyond your project cap if billing data hasn't processed before more charges are accrued. https://ai.google.dev/gemini-api/docs/billing#project-spend-caps https://ai.google.dev/gemini-api/docs/billing#project-spend-... That's a soft cap, not a hard cap
  - deleted 4mo ago
    [deleted]
  - movedx01 4mo ago
    AI studio added it recently, Vertex not.
deleted 4mo ago
[deleted]
simonw 4mo ago
Huh, so they do. Anthropic: https://support.claude.com/en/articles/8977456-how-do-i-pay-for-my-claude-api-usage https://support.claude.com/en/articles/8977456-how-do-i-pay-... - you can pre-pay and get a hard cutoff. OpenAI: https://community.openai.com/t/how-to-set-billing-limits-and-restrict-model-usage-for-a-project-via-openai-api/1087771/11 https://community.openai.com/t/how-to-set-billing-limits-and... - last time I looked OpenAI had a soft but not hard limit, I guess they fixed that last year. I remember bugging them both about this last year, I need to update my mental model!
tadfisher 4mo ago
Based on experience, Google Cloud. No idea if that translates to Gemini usage billing.
- simonw 4mo ago
  Gemini added prepaid billing and spending caps a few weeks ago: https://twitter.com/OfficialLoganK/status/2044516262152442315 https://twitter.com/OfficialLoganK/status/204451626215244231...
  - js4ever 4mo ago
    I cancelled my whole GCP account a month ago because I was too afraid of getting charged hundreds of thousands overnight like all peoples on Reddit
kaufmann 4mo ago
I tried Alibaba Cloud. They have no caps. This was the reason to cancel my account there. Deepseek has a prepaid model. (Pretty impressive, what fits into 10 Dollar)
- brianwawok 4mo ago
  Literally every credit card I own allows me to make a virtual card that is either single use or has a cap.
  - dayone1 4mo ago
    Like which one? Most I know don’t have this feature
    - brianwawok 4mo ago
      My business card is a Cap one spark business 2%.. get 2% cash on everything which is nice.
  - Hardwired8976 4mo ago
    Does not matter, you still owe what you used for a service
BoredPositron 4mo ago
There is a scheme to send gifts with a compromised anthropic key even if the limit is reached.
wahnfrieden 4mo ago
Microsoft
siva7 4mo ago
Who doesn't have hard billing caps for inference? Microsoft, Google and AWS my friend. And you know who uses Microsoft, Google and AWS? Almost all big corporations do use them instead of direct OAI or Anthropic API because all their contracts and infra are built around the big cloud providers.

Both OpenAI and Anthropic have billing caps… who doesn’t?

by a13n 4mo ago

Both OpenAI and Anthropic have billing caps… who doesn’t?

totaa 4mo ago

Google Vertex

srameshc 4mo ago
https://aistudio.google.com/spend https://aistudio.google.com/spend ? Monthly spend cap
- mips_avatar 4mo ago
  I spent two hours the other day trying to figure out how to manage spend on gcp, i gave up and used openrouter and cloudflare.
- squeaky-clean 4mo ago
  > Long-running tasks like batch mode completions and agent sessions may incur overages beyond your project spend cap. > Billing data processing times can be delayed in AI Studio, up to around 10 minutes. You may experience overages beyond your project cap if billing data hasn't processed before more charges are accrued. https://ai.google.dev/gemini-api/docs/billing#project-spend-caps https://ai.google.dev/gemini-api/docs/billing#project-spend-... That's a soft cap, not a hard cap
- deleted 4mo ago
  [deleted]
- movedx01 4mo ago
  AI studio added it recently, Vertex not.

deleted 4mo ago

[deleted]

simonw 4mo ago

Huh, so they do. Anthropic: https://support.claude.com/en/articles/8977456-how-do-i-pay-for-my-claude-api-usage https://support.claude.com/en/articles/8977456-how-do-i-pay-... - you can pre-pay and get a hard cutoff. OpenAI: https://community.openai.com/t/how-to-set-billing-limits-and-restrict-model-usage-for-a-project-via-openai-api/1087771/11 https://community.openai.com/t/how-to-set-billing-limits-and... - last time I looked OpenAI had a soft but not hard limit, I guess they fixed that last year. I remember bugging them both about this last year, I need to update my mental model!

tadfisher 4mo ago

Based on experience, Google Cloud. No idea if that translates to Gemini usage billing.

simonw 4mo ago
Gemini added prepaid billing and spending caps a few weeks ago: https://twitter.com/OfficialLoganK/status/2044516262152442315 https://twitter.com/OfficialLoganK/status/204451626215244231...
- js4ever 4mo ago
  I cancelled my whole GCP account a month ago because I was too afraid of getting charged hundreds of thousands overnight like all peoples on Reddit

kaufmann 4mo ago

I tried Alibaba Cloud. They have no caps. This was the reason to cancel my account there. Deepseek has a prepaid model. (Pretty impressive, what fits into 10 Dollar)

brianwawok 4mo ago
Literally every credit card I own allows me to make a virtual card that is either single use or has a cap.
- dayone1 4mo ago
  Like which one? Most I know don’t have this feature
  - brianwawok 4mo ago
    My business card is a Cap one spark business 2%.. get 2% cash on everything which is nice.
- Hardwired8976 4mo ago
  Does not matter, you still owe what you used for a service

BoredPositron 4mo ago

There is a scheme to send gifts with a compromised anthropic key even if the limit is reached.

wahnfrieden 4mo ago

Microsoft

siva7 4mo ago

Who doesn't have hard billing caps for inference? Microsoft, Google and AWS my friend. And you know who uses Microsoft, Google and AWS? Almost all big corporations do use them instead of direct OAI or Anthropic API because all their contracts and infra are built around the big cloud providers.