RomulusHill

6 ms·

1. 1.▲
   by RomulusHill 4d ago

   Well it's got editable response wait, so that it can re-think its response before sending it to you if the course of your message changes. I just thought it was a nice idea to pre-generate the response (yes admittedly it burns more tok
2. 2.▲
   Show HN: Don't Hit Send – the model answers while you type(github.com)

   7 points by RomulusHill 5d ago|3 comments
3. 3.▲
   by RomulusHill 17d ago

   Hi Gertlabs, my inference company has actually started offering Ornith1.5 today for 9B and 35B A3B. If you are still interested, send me a message on X and I'll help you get started! https://x.com/romulushill https:&#
4. 4.▲
   Show HN: Scalattice Modelmeter. OSS price and latency bench for open models(scalattice.com)

   1 points by RomulusHill 24d ago|0 comments
5. 5.▲
   Show HN: I built a hypervisor and client for inference on consumer compute(scalattice.com)

   3 points by RomulusHill 2mo ago|0 comments