5 ms·
Guardrailing is usually done with a smaller model (< 1b) to filter out simple "not aligned prompt" and not waste compute.
by eden-u4 6mo ago
Guardrailing is usually done with a smaller model (< 1b) to filter out simple "not aligned prompt" and not waste compute.
- anuramat 6mo agosure, but here we start with a performance problem, not compute