9 ms·
Not sure I get it. The model you're improving is local? If so how do you even calculate cost compared to an API
by jack_pp 2mo ago
Not sure I get it. The model you're improving is local? If so how do you even calculate cost compared to an API
- SilenN 2mo agoOpen source models. wmo routes requests between frontier models and open source models that continuously train using Tinker. As the smaller models improve, more traffic gets routed to them. Calculating cost is just tokens in/out.
- handfuloflight 2mo agoWhat are the costs to train and use the Tinker models?
- SilenN 2mo agoExpensive, in the thousands. We have our own infra in house and are working on bringing these costs down
- handfuloflight 2mo agoBut in the thousands can pencil out if you're saying tens of thousands over calling the frontier models, no?
- SilenN 2mo agoExactly