sid-the-kid

5 ms·

1.
by sid-the-kid 8mo ago
never head of InWorld. Pretty impressive.
2.
by sid-the-kid 8mo ago
ooof. You saw the Chinese text. Yup, that's super annoying. We are trying to squash that hallucination. Thanks for the feedback! That's helpful!
3.
by sid-the-kid 8mo ago
Thank you! We are considering to release an open-source version of the model. Somebody will do it soon. Might as well be us. We are mostly concerned with the additional overhead of releasing and then supporting it. So, TBD.
4.
by sid-the-kid 8mo ago
One thing that is interesting: LLMs pipelines have been highly optimize for speed (since speed is directly related to cost for companies). That is just not true for real-time DiTs. So, there is still lots of low hanging fruit for how we (an
5.
by sid-the-kid 8mo ago
Good question! Software gets democratized so fast that I am sure others will implement similar approaches soon. And, to be clear, some of our "speed upgrades" are pieced together from recent DiT papers. I do think getting everyth
6.
by sid-the-kid 8mo ago
it's a fair concern. but, we don't know r0fl. and we are not astroturfing. even I am surprised with how many opnely positive comments we are getting. it's not been our experience in the past.
7.
by sid-the-kid 8mo ago
Makes sense. The init should be about 10s. But, after that, it should be real time. TBH, this is probably a common confusion. So thanks for calling it out.
8.
by sid-the-kid 8mo ago
Thank you! Yes, right now we are using Qwen for the LLM. They also released a super fast TTS model that we have not tried yet, which is supposed to be very fast.
9.
by sid-the-kid 8mo ago
thanks for the feedback. that's helpful. Ya, some avatars have worse lip synch than others. It depends a little on how zoomed in you are. I am double checking now to make 100% sure we return the original audio (and not the encoded&#x2F
10.
by sid-the-kid 8mo ago
And, just like that, Max Headroom is back: https://lemonslice.com/try/agent_ccb102bdfc1fcb30
11.
by sid-the-kid 8mo ago
1) yes on Max Headroom. we are on it. 2) it already is real time...?
12.
by sid-the-kid 8mo ago
Fix deployed! This is why it's good to launch on hacker news. thanks for the tip.
13.
by sid-the-kid 8mo ago
glad we found somebody who likes it as much as us! BTW, biggest thing we are working to improve is speed of the response. I think we can make that much faster.
14.
by sid-the-kid 8mo ago
curious what avatar you think is poor quality? Or, what you think is poor quality. i want to know :)
15.
by sid-the-kid 8mo ago
thanks! it just barley worked last year, but not much else. this year it's actually good. we got lucky: it's both new tech and turned out to be good quality.
16.
by sid-the-kid 8mo ago
Good catch! Working on a fix now.
17.
by sid-the-kid 8mo ago
Our text control is good, especially for emotions. For example, you can add the text prompt: "a person talking. they are angry", and agent will have an angry expression. You can also control background motions (like ocean waves, o
18.
by sid-the-kid 8mo ago
Good question. When using the API, you can bring any voice agent (or LLM). Our API takes in what the agent will say, and then streams back the video of the agent saying it. For the fully hosted version, we are currently partnered with Eleve
19.
by sid-the-kid 8mo ago
thank you! it's by far the thing I have worked on that I am most proud of.
20.
by sid-the-kid 8mo ago
Very cool! Thanks for sharing. I love your use-case of turning an AI coding agent into more of an AI employee. Will be interesting to see if users can connect better with the product this way.
21.
by sid-the-kid 8mo ago
hey HN! one of the founders here. as of today, we are seeing informational avatars + roleplaying for training as the most common use cases. The roleplaying use-case was surprising to us. Think a nurse training to triage with AI patients. Or
22.
by sid-the-kid 1y ago
We use modal ( https://modal.com/ ). They give us GPUs on-demand, which is critical for us so we are only paying for what we are using. Pricing is about $2/hr per GPU (as a baseline of the costs). Long story short, thing
23.
by sid-the-kid 1y ago
that's a good idea! Would be especially cool if the human is charismatic and does a good job driving the convo. Maybe we can try it out with a streamer.
24.
by sid-the-kid 1y ago
Looked it up. Cool reference.
25.
by sid-the-kid 1y ago
Does he? I can't find him.
26.
by sid-the-kid 1y ago
IMO, most videos models will be fully real time within 2 years. You will be able to pick a model, imagine any world and then be fully immersed in it. Walk around any city interacting with people, first person shooter games on any map with c
27.
by sid-the-kid 1y ago
Nice find! I hand't seen this before (and will take a deeper look later). It looks like this is an approach to better utilize the GPU memory. And, we would probably benefit from this to get more of a speed-up, which would also help us
28.
by sid-the-kid 1y ago
Ya. You always think you cross your Ts. But, the law always holds.
29.
by sid-the-kid 1y ago
Glad you like it! IMO, biggest things to improve on are 1) time to video response and 2) being able to generate more complicated videos (2 people talking to each other, a person walking + talking, scene cuts while talking).
30.
by sid-the-kid 1y ago
Good question. I guess depends on how many users we get. Each users gets their own dedicated GPU. Most video generations systems (and AI systems in general) can share GPUs during generation. Since we are real time, we don't do that. So

More ›