6 ms·
No need to be snarky. The choice to default to FP32 is inspired by the fact that most typical use cases don't need double-precision (GPU shader languages and ga
by olokobayusuf 1y ago
No need to be snarky. The choice to default to FP32 is inspired by the fact that most typical use cases don't need double-precision (GPU shader languages and game engines do this all the time). This in turn allows us to vectorize code for 2x throughput compared to using FP64. We're gonna add a flag to change the default floating-point precision for devs who need extra precision.
See docs: https://docs.fxn.ai/predictors/requirements#floating-point-values https://docs.fxn.ai/predictors/requirements#floating-point-v...