Flex tier is just as cheap but you don't need to deal with batching or waiting. I see it completing in about ~3x-10x the latency of normal calls, so in seconds.

Flex tier is just as cheap but you don't need to deal with batching or waiting. I see it completing in about ~3x-10x the latency of normal calls, so in seconds. You can always route back to regular if you're getting 429'd on flex too. Flex is also easier to get caching to work, there is a little futzing around with OAI's implicit caching but if you do the upfront work you can get haiku quality responses with caching in close to realtime for 1/7th the cost and you don't need to design a polling loop to check for batch completions