6 ms·The model supports batch inference, so all prompts are sent to the model, and we parse the results.by rocauc 10mo agoThe model supports batch inference, so all prompts are sent to the model, and we parse the results.