russ

7 ms·

1.
Show HN: Open-source turn detection model for voice AI
8 points by russ 2y ago|1 comments
2.
by russ 2y ago
Yeah, that would be really handy too.
3.
by russ 2y ago
This is very cool! I’ve wanted something like CodeMic for a long time. Back when I was at Twitter, we used Review Board for code reviews (this was in 2009, before GH was a thing for most companies). It was tough to thoughtfully review large
4.
by russ 2y ago
You got it! Hope you have some fun with it. :)
5.
by russ 2y ago
Haven’t played Codenames in a long while, but made this 8 years ago to play with family and friends on TVs. Right in time for the holidays! demo: https://dsa.github.io code: https://github.com/dsa/dsa.github
6.
by russ 2y ago
Haha yup, I’m that Russ. Really appreciate your kind words. <3 I’ll shoot you an email and let’s chat!
7.
by russ 2y ago
This is super cool. One neat idea: when I'm in offline mode, I can clone my voice, provide some context data/sources, and have my AI clone answer calls for me. It can give me a summary of conversations it had each day and allow m
8.
by russ 2y ago
Heh, actually I'm pretty sure I've come across your X profile before. :) You're definitely in a small minority of folks with a deep(er) understanding of WebRTC.
9.
by russ 2y ago
You really don’t need to know about WebRTC at all when you use LiveKit. That’s largely thanks to the SDKs abstracting away all the complexity. Having good SDKs that work across every platform with consistent APIs is more valuable than the S
10.
by russ 2y ago
Doesn’t sound right. I’d love to dig into this some more. Would you mind shooting me a DM on X? @dsa
11.
by russ 2y ago
Field CTO — hi @Sean-Der :wave: Fractional CTO sounds like a disaster lol
12.
by russ 2y ago
Which components feel ad hoc? In most real applications, the agent has additional logic (function calling, RAG, etc) than simply relaying a stream to the model server. In those cases, you want it to be a separate service/component that
13.
by russ 2y ago
There’s Ultravox as well (from one of the creators of WebRTC): https://github.com/fixie-ai/ultravox Their model builds a speech-to-speech layer into Llama. Last I checked they have the audio-in part working and they’re
14.
by russ 2y ago
There’s a ton of complexity under the “relatively simple use case” when you get to a global, 200M+ user scale.
15.
by russ 2y ago
50% human speaking at $0.06/minute of tokens 50% AI speaking at $0.24/minute of tokens we (LiveKit Cloud) charge ~$0.0005/minute for each participant (in this case there would be 2) So blended is $0.151/minute
16.
by russ 2y ago
We had our playground ( https://playground.livekit.io ) up for a few days using our key. Def racked up a $$$$ bill!
17.
by russ 2y ago
I had no idea! <3 Thank you for sharing this, made my weekend.
18.
by russ 2y ago
It's using the same model/engine. I don't have knowledge of the internals, but a different subsystem/set of dedicated resources though for API traffic versus first-party apps. One thing to note is there is no separate TT
19.
Show HN: Open source framework OpenAI uses for Advanced Voice(github.com)
266 points by russ 2y ago|61 comments
20.
by russ 2y ago
It’s insanely fast. Here’s an AI voice assistant I built that uses it: https://cerebras.vercel.app
21.
by russ 2y ago
Here’s an AI voice assistant we built this weekend that uses it: https://x.com/dsa/status/1828481132108873979?s=46&t=uB6padbn...
22.
Ultravox: open source audio-to-audio LLM(github.com)
6 points by russ 2y ago|0 comments
23.
by russ 2y ago
LiveKit Agents, which OpenAI uses in voice mode is also open source: https://github.com/livekit/agents
24.
by russ 3y ago
But we don't handle interruptions yet, that's some cool stuff @yanyan_evie!
25.
by russ 3y ago
We recently made it a lot easier to build your own KITT too: https://github.com/livekit/agents
26.
Show HN: Agents – Open source framework for realtime multimodal AI(github.com)
2 points by russ 3y ago|0 comments
27.
by russ 3y ago
100%. My dad was an electrical engineer in the 70s and 80s and ended up transitioning to sales, given that it paid much more.
28.
by russ 3y ago
Zoom does use a custom protocol. This is why it doesn’t work nearly as well when you take a call in the browser client. Not because WebRTC isn’t up to the task, but because Zoom hasn’t invested in it. Ignoring costs, while having someone ho
29.
by russ 3y ago
You can do that with LiveKit Egress: https://github.com/livekit/egress
30.
by russ 3y ago
HLS is a client-driven protocol, so it has high-scale but variable latency. You could build a mostly one-way webinar experience using it, but definitely not a conference call experience. The primary issue with traditional WebRTC media serve

More ›