marshalla

11 ms·

1.
by marshalla 1mo ago
My prediction is that soon every mid-size+ company will have their own hardware running an open-weight model and all employees will be required to connect to it and it alone for inference.
2.
by marshalla 1mo ago
Nice, how well does WhisperKit work for diarization?
3.
by marshalla 2mo ago
lol fair that's very dev of you. The next gen of models will prob one shot my app anyway. I like the idea of having a completely headless auto recording system. I was against it initially over privacy concerns but with completely on-de
4.
by marshalla 2mo ago
I'm building one that finally seems to be reasonably stable https://mimicscribe.app/ . Speaker identification is a huge trick to do on device. I've masked by sentence and capture embeddings within that mask to get
5.
by marshalla 3mo ago
venice.ai? Ok nice I'll check it out. thanks. ya I added the openai compat endpoint, no brainer.
6.
by marshalla 3mo ago
Right? I feel like local model support is something that has strong ideological appeal and might influence someones feeling towards the app, but when it comes down to it most people will probably just use a cloud model for larger tasks unle
7.
by marshalla 3mo ago
lol that'd be a trick. I'd have it purposely misidentify to cheaper brands to mess with people.
8.
by marshalla 3mo ago
Hey thanks! Good call. I had limited success getting Qwen 3.5 9B working for some of the longer prompts that require lots of json output. I feel like completely on-device is so close to being usable for this stuff though. I should revisit t
9.
by marshalla 3mo ago
No joke about the indexing feeling slow. Could that be run as a lower priority task? handy app!
10.
by marshalla 3mo ago
Matt, Thanks! I just tried Hedy, same concept, also a great tool. It's todos are nice. MimicScribe works well with any Apple silicon Mac so it'll feel snappy on an M1 with 8GB of RAM even. It uses Apple's on-device ML acceler
11.
Show HN: On-device transcriber that's 97% accurate at identifying speakers(mimicscribe.app)
32 points by marshalla 3mo ago|10 comments