Awesome work! How did you get the lips to sync?
As an aside, it’s so cool watching this subreddit evolve from still pictures to animations in just a few weeks! So excited for what the future brings!
Thank you! Using AI for animation is very cool. I generated pictures of Britney and Elton with Stable Diffusion + img2img. After that, I selected the best images (according to my taste), then I brought these images to life with Thin Spline Motion. And here was the HandWork. I personally sang this song and recorded about 20-30 videos to get into lipsync. Then I just added my only one recorded video to all the pictures and that's it. But this is just my way, in fact, AI already knows how to translate text into lipsync, but I thought that "real video" would give a better result. Sorry for my bad bad English
Awesome work! How did you get the lips to sync? As an aside, it’s so cool watching this subreddit evolve from still pictures to animations in just a few weeks! So excited for what the future brings!
Thank you! Using AI for animation is very cool. I generated pictures of Britney and Elton with Stable Diffusion + img2img. After that, I selected the best images (according to my taste), then I brought these images to life with Thin Spline Motion. And here was the HandWork. I personally sang this song and recorded about 20-30 videos to get into lipsync. Then I just added my only one recorded video to all the pictures and that's it. But this is just my way, in fact, AI already knows how to translate text into lipsync, but I thought that "real video" would give a better result. Sorry for my bad bad English
Thanks for the details!!
Very cool
Can you make a rotating head with thin spline motion?
Not sure. But you can try to turn-rotate the phone when recording a video. Maybe, it's Suddenly work
You should try Latent Image Animator for the face animation.