hjessmith

6 ms·

1.
Show HN: DoodleMeme – Animate Hand Drawings Without Generative AI(doodlemate.com)
4 points by hjessmith 2mo ago|0 comments
2.
Show HN: DoodleMeme – Animated Memes from Your Hand Drawn Doodles (No GenAI)(doodlemate.com)
5 points by hjessmith 3mo ago|0 comments
3.
by hjessmith 4mo ago
I'm working on a web app that animates hand drawn human characters. You try it here without any login or anything: http://doodlemate.com It doesn't use generative AI, instead it auto-rigs the drawings in just a few sec
4.
by hjessmith 4mo ago
Thank you! It’s a web app, but we designed it to be mobile first. You can absolutely visit the website, take a picture, and show the animation to your daughter all on your phone. If you do give it a try, please let me know how it goes!
5.
by hjessmith 4mo ago
That's the plan! Glad to hear DoodleMate brought a smile to your face.
6.
by hjessmith 5mo ago
That's a good question. I would say that the two approaches are quite different and bring different strengths to the table. The major strength of genAI is that it is open-ended. But it comes with costs. GenAI video is expensive to gene
7.
by hjessmith 5mo ago
I hope she likes! Please let me know how it goes and if there's any functionality she/you would want.
8.
by hjessmith 5mo ago
That's a good question. The distinction is between generative AI (which takes in a prompt or image and generates every pixel of a new video) and non-generative AI models (e.g. classifiers, segmentation models, and pose estimation model
9.
Show HN: DoodleMate: Animate Your Child's Hand Drawings Without Generative AI(doodlemate.com)
15 points by hjessmith 5mo ago|12 comments
10.
by hjessmith 3y ago
I'm a student of good animation myself (know the 12 principles of animation by heart, got a copy of The Illusion of Life right next to my desk, etc.) and have great respect for what professional animators can do. And while I (maybe mor
11.
by hjessmith 3y ago
Yeah, I think that'll happen. I think it's already happening. And if someone wraps it in a terrible app with ads, makes millions of dollars, and I never see any of the money, yes I'll be very sad. But I'm trying to take
12.
by hjessmith 3y ago
I’m curious to learn more.
13.
by hjessmith 3y ago
Sounds awesome! Let’s do it.
14.
by hjessmith 3y ago
Love the idea. Feel free to reach out if you think there’s room for collaboration.
15.
by hjessmith 3y ago
You're the first stranger to ever compliment my coding style. I feel all warm and fuzzy now.
16.
by hjessmith 3y ago
Yes. I did most of this as a postdoc at FAIR, Meta's AI research group.
17.
by hjessmith 3y ago
It’s not metadata, you would see that when you upload the photo at the beginning. I’m guessing that the nose key point is located below the shoulders in your child’s drawing? That’s a known issue caused by how we ‘apply’ poses onto the cha
18.
by hjessmith 3y ago
If you post your creation to social media, please use #FAIRAnimatedDrawings. I'd love to see what you create!
19.
by hjessmith 3y ago
As written now, it expects 3D motion data. Extending it to support 2D motion data is doable, but will take time. Feel free to open a github issue requesting it if you'd like me to prioritize it.
20.
by hjessmith 3y ago
It currently only outputs .mp4 and .gif files. You could probably use these as game assets, but I don't think it would be optimal. The rendering code utilizes an MVC framework. If you need the animation output in a .obj format or somet
21.
by hjessmith 3y ago
You might check out the technical paper, the background section lists some relevant related works on non-photorealistic pose estimation. One work that seems particularly pertinent to your use case is: Gesture3D: Posing 3D Characters via Ges
22.
by hjessmith 3y ago
Glad to hear it was easy for you to get up and running, but where did come across the repo? It's been in 'stealth release' mode for a few months now, but nothing was publicly announced until today.
23.
by hjessmith 3y ago
It's equally important to stretch before coding and stretch before dancing.
24.
by hjessmith 3y ago
I don't know who would speak out against it. The MIT license certainly allows for it, and I don't actually own it... I just wrote it :)
25.
by hjessmith 3y ago
Glad you got it working. And glad you appreciate my sick dance moves :)
26.
by hjessmith 3y ago
I assume you're referring to the demo at sketch.metademolab.com? The server is returning an .mp4 file that is displayed by your browser, so you should be able to download it. On Chrome, if I maximize the video and click the three verti
27.
by hjessmith 3y ago
Hey! That’s my project! Code and dataset are here: https://github.com/facebookresearch/AnimatedDrawings And a browser-based version of it is here: http://sketch.metademolab.com/
28.
by hjessmith 5y ago
If it makes you feel better, there's no data being collected other than the images and annotation fixes (and that only occurs if you click 'agree' on the consent page). You also don't need to be signed in Facebook or any
29.
by hjessmith 5y ago
That's a good point. FB/Meta did a blog post talking about the tech. There are some failure examples there: https://ai.facebook.com/blog/using-ai-to-bring-childrens-dra...