KianHooshmand

5 ms·

1. 1.▲
   by KianHooshmand 3y ago

   Vocode || Engineering (multiple roles) || SF/Remote || Full-time/Contract || https://vocode.dev We (Vocode) empower developers to connect the world with magical conversational AI experiences. Our hosted APIs and open s
2. 2.▲
   by KianHooshmand 3y ago

   Vocode || Engineering (multiple roles) || SF/Remote || Full-time/Contract || https://vocode.dev We (Vocode) empower developers to connect the world with magical conversational AI experiences. Our hosted APIs and open s
3. 3.▲
   Vocode (YC W23) is hiring to build realistic voice bots(vocode.notion.site)

   1 points by KianHooshmand 3y ago
4. 4.▲
   Show HN: Ycinterview.ai – Practice the YC Interview with Cloned AI Partners(ycinterview.ai)

   5 points by KianHooshmand 3y ago|1 comments
5. 5.▲
   by KianHooshmand 3y ago

   In the main post! It's +1-650-729-9536 :)
6. 6.▲
   by KianHooshmand 3y ago

   Yes! Give it a try on the phone call and let us know what you think – would love feedback!
7. 7.▲
   by KianHooshmand 3y ago

   thank you! All credit to Rime for the Gen Z voice :)
8. 8.▲
   by KianHooshmand 3y ago

   Yep. We are working on adding more integrations (and want to have a full self hosted stack)... we're open to contributors and help from the community if there's something you'd like to see added! We just got a PR for adding C
9. 9.▲
   by KianHooshmand 3y ago

   absolutely! you can just plug in your own LLM... so it can be trained on anything you like and the library will make it voice-based!
10. 10.▲
    by KianHooshmand 3y ago

    Thank you for the feedback! Actually it can be configured to use any transcriber you like... Twilio just pipes the audio to us and we can use any of our integrations (Deepgram, Whisper, AssemblyAI, Google Cloud, etc.) for the ASR :)
11. 11.▲
    by KianHooshmand 3y ago

    totally agree! this is a really cool use case :)
12. 12.▲
    by KianHooshmand 3y ago

    We chunk it up per sentence so it has some context!
13. 13.▲
    by KianHooshmand 3y ago

    Lily is epic. Highly recommend checking out Rime when it's available!!
14. 14.▲
    by KianHooshmand 3y ago

    Totally! We actually use LangChain for the OpenAI wrapper agents we give out of the box (you can plug in your own custom one as well)
15. 15.▲
    by KianHooshmand 3y ago

    thank you!
16. 16.▲
    by KianHooshmand 3y ago

    We definitely want to do this! We've been talking about it (it's much better like you said for realtime); it's been hard to juggle everything we've wanted to add.. which is why we think this makes so much more sense open
17. 17.▲
    by KianHooshmand 3y ago

    Yep we're definitely getting a large volume right now – working on it!
18. 18.▲
    by KianHooshmand 3y ago

    Ah! Right now our default is set to use OpenAI... but you can actually use local LLMs by creating a custom agent. We're going to add a full stack of local STT/TTS/LLM... just haven't had time for it yet! If anyone wants
19. 19.▲
    by KianHooshmand 3y ago

    thank you! love your feedback and please feel free to drop any questions in discord/on github
20. 20.▲
    by KianHooshmand 3y ago

    thank you! it's not live right now... but stay tuned for april 1 :)
21. 21.▲
    by KianHooshmand 3y ago

    Thank you!! Really glad you enjoyed it We actually have no clue... but it seems to be holding up well. We can scale up the CPU as necessary but not sure about Twilio. I guess we will find out!
22. 22.▲
    by KianHooshmand 3y ago

    We totally agree – thank you for the feedback! :)
23. 23.▲
    by KianHooshmand 3y ago

    thank you for the kind words! absolutely agree – we're gonna beef up our tutorials and documentation... just have had so much to do but it's definitely one of our focuses now. stay tuned! :)
24. 24.▲
    by KianHooshmand 3y ago

    yes! You can run the local version here in your bash https://docs.vocode.dev/python-quickstart#self-hosted
25. 25.▲
    by KianHooshmand 3y ago

    And yes! It's STT/LLM/TTS where you can choose between different providers and run it across different platforms. It can be turn based (like the demo you linked from twitter) or streaming (this allows for conversation with in
26. 26.▲
    by KianHooshmand 3y ago

    Our belief is that at some point OpenAI will add a speech-to-speech model. This will improve the library functionality (since now the whole stack is controlled by a single entity, so the product will naturally be better latency/quality
27. 27.▲
    by KianHooshmand 3y ago

    Of course! We loved working on this and chose to open source precisely for this reason. Heavily inspired by the work people are doing on Langchain and providing a usability/developer layer on top of foundational models. Nothing like th
28. 28.▲
    by KianHooshmand 3y ago

    We haven't added the ability to switch languages mid conversation... but that's a very cool feature! You can configure the initial language with the library though! So it works across several languages that are supported by the ST
29. 29.▲
    by KianHooshmand 3y ago

    Ah! Have not tried this but will look into it – thank you :) Our docs are hosted on Mintlify
30. 30.▲
    Launch HN: Vocode (YC W23) – Library for voice conversation with LLMs

    379 points by KianHooshmand 3y ago|116 comments