6 ms·
That model costing $3/M output tokens on Openrouter is a mystery to me.
by pmdr 25d ago
That model costing $3/M output tokens on Openrouter is a mystery to me.
- nicce 25d ago32GB GPUs are getting expensive so that also affects the price.
- pmdr 25d agoI didn't think about GPU size. So they don't run this small model on B200s or something?
- nicce 25d agoThis is open model intended for local usage. So, it doesn't matter. If the end user wants to run this on their own hardware, cost is defined by the electricity price + the price of the processing power. Providers can increase the price as long as the users don't switch for buying the hardware themselves instead.