8 ms·Also tokens/sec are not only dependent on parameter size, so that is kind of a brittle theory.by flawn 2mo agoAlso tokens/sec are not only dependent on parameter size, so that is kind of a brittle theory.