yashchimata

5 ms·

1. 1.▲
   Show HN: Statgate, statistically calibrated ship/block CI gates for LLM evals(github.com)

   2 points by yashchimata 2mo ago|0 comments
2. 2.▲
   by yashchimata 2mo ago

   One thing i keep thinking: you only run the pelican once per model. Run the same model a few times and you get some different pelicans, so some of "this one is better" might just be which run you picked for it. Would love to see 8