6 ms·
I'm surprised that Nemotron gets mentioned at all. In my experiments with it for coding tasks it performed extremely poorly, essentially unusable.
by vcryan 2mo ago
I'm surprised that Nemotron gets mentioned at all. In my experiments with it for coding tasks it performed extremely poorly, essentially unusable.
- nostrebored 2mo agoit is pretty good at instruction following and has extremely fast decode.
- jameshush 2mo agoI focus on realtime voice AI uses cases and nemotron's time to first token is INSANELY fast. It's become a legit option for voice use cases