synapticpaint

14 ms·

1.
by synapticpaint 2y ago
The camera motions do not need to be the same. Gaussian splatting reconstructs the scene in 3d, and you can then render the scene from arbitrary angles, so they just gave it a random camera motion to show you the 3dness of it.
2.
by synapticpaint 3y ago
This technology is already close to making animation. Check out some of my experiments with text to video here: https://www.youtube.com/watch?v=CgKNTAjQpkk https://youtu.be/X0AhqMhEe-c
3.
by synapticpaint 3y ago
Pretty close. Not the same kind of animation, but here are some of my experiments with text to video for narrative content: https://www.youtube.com/watch?v=CgKNTAjQpkk https://youtu.be/X0AhqMhEe-c You'
4.
by synapticpaint 4y ago
"The flickering comes from the fundamental nature of the de-noising mechanism involved in the diffusion model." -- agreed "Keeping the same seed wouldn't be helpful if you want the image to move." -- No, I'm us
5.
by synapticpaint 4y ago
Are you using canny mode? One of the other modes (HED, segmentation, or depth) may give you more consistency. Lmk how it goes if you try this.
6.
by synapticpaint 4y ago
Not really, but I think there are other things you can do to reduce flickering that I'm looking into.
7.
by synapticpaint 4y ago
Yes, it's asking SD for an image with some set of characteristics, and SD has some notion of what is plausible from what it saw during training.
8.
by synapticpaint 4y ago
No, ControlNet wasn't made to solve temporal consistency, it was made to add more control (hence the name) to image models. I am using it in a way that the authors may not have thought of, because the paper doesn't mention video e
9.
by synapticpaint 4y ago
So, the video was generated by applying ControlNet to the input video frame by frame. Every inference setting is the same for every frame -- seed, prompt, CFG, steps, and sampler. The only thing that changes frame to frame is that the pose
10.
by synapticpaint 4y ago
Correct, it's generated by SD.
11.
by synapticpaint 4y ago
Here is a preliminary test for video editing using ControlNet I made: https://www.youtube.com/watch?v=u52MOA4YaGk As you can see, there is still quite a bit of flicker, I'm working to reduce that. But the consistency i
12.
by synapticpaint 4y ago
Proof of concept for video to video editing. An input video is transformed to an output that matches the pose but with an AI generated character via a prompt. There is some flicker, but the result is much more consistent than existing metho
13.
by synapticpaint 4y ago
I wouldn't say that "the opportunity all seems to be on the front end". Specifically for stable diffusion, there are a lot of different ways to use the model. I think we're just starting to scratch the surface of what SD
14.
by synapticpaint 4y ago
Hi, I run http://synapticpaint.com/ and using AI image generation for graphic novels/comics is one of the directions I'm exploring. If you're interested in collaborating to make your graphic novel a reality (
15.
by synapticpaint 4y ago
On AWS, a g5 instance costs $1/hr. I can generate roughly 10 images per minute (should be able to get this down with some optimization), so 600 images per hour, so the cost per image is 1/6 of a cent, before adding overhead (idle
16.
by synapticpaint 4y ago
"Finally, a vital question is, how will this affect today’s working artists? Here the answer is not so optimistic." I have a different take on this. I think this technology will allow more people, not less, to make money as a livi
17.
Show HN: Create your own DreamBooth models for $2. Share, try, or remix models(synapticpaint.com)
1 points by synapticpaint 4y ago|0 comments
18.
by synapticpaint 4y ago
Cheaper services are here now: https://synapticpaint.com/ I charge $2-$4 per model training. I don't think that the profile pic/avatar space is going to be very profitable. As you can see from this post, there is
19.
by synapticpaint 4y ago
I don't think that AI image generation in its current form replaces human creativity. You still need a human to guide the process, compose the image, judge the output, etc. What's being automated is the manual, traditional process
20.
by synapticpaint 4y ago
That's true. I just wanted to provide some context for OP and others reading since they mentioned an interest in AI generation, and I think not everyone knows that dreambooth + stable diffusion has this kind of capability.
21.
by synapticpaint 4y ago
It sounds like your app turns photos into a watercolor style image? You can definitely do this faster with Stable Diffusion (~6s per image before optimization). Here's how I would approach it: train a dreambooth model on watercolor sty
22.
by synapticpaint 4y ago
Agree that dreambooth is the future. I'm building an app that lets users with no technical background train their own dreambooth models for $2-$4: https://synapticpaint.com/dreambooth/info/ They can also shar
23.
by synapticpaint 4y ago
I'm building an app that lets users with no technical background train their own dreambooth models for $2-$4: https://synapticpaint.com/dreambooth/info/ They can also share their trained models for others to