price per token on its own tells you nothing.. what matters is tokens per successful outcome a cheap model that needs three retries costs more than an expensive

price per token on its own tells you nothing.. what matters is tokens per successful outcome a cheap model that needs three retries costs more than an expensive one that gets it right first go. anyone actually tracking cost per completed task rather than cost per call ? it is quite a difficult task to define completion as it is a qualitative aspect and can vary from every individual.