AI Video animation Exploration

For over a year I have been experimenting with various AI video and animation workflows. The early days this technology was amusing but not consistent or useful for anything outside of it being a curiosity. As many of you know things move quickly in this AI space and the difference of what you can now do with AI video compared to last year is kind of like the difference between a 2001 flip-phone and the first iPhone. It’s still rough around the edges but I would now say this is now a usable platform for generating constant usable creative content.

Yes it is still the wild-west right now in this space so there is currently no best practice. It’s basically share what’s working best for you at the moment and for me it’s going old school. With making a collage of what I want to be animated. Most people including myself have been generating imagery from textual or image to image prompting and iterating in ComfyUI with Flux, Stable Diffusion and various LoRa’s (a smaller file that contains more detailed info of a subject) touching it all up in Photoshop than moving to 3rd party platform for animation such as Runway or KlingAI. Yup skipping all that and going into Photoshop and cutting up a variety of images and collaging them together not to different than in the 90’s. Granted Adobes generative fill capabilities work wonders. For instance look at the original image of the King he is behind a plate of chicken nuggets on a table. It would have taken several hours to remove all that and add the bottom of his hands. This process was less than 5 minutes by my guess. It was so quick that I did not realize how amazing that was in and of itself. Until I was creating the final PNG to use to generate the video.

 

 

With that image I went through around 8 generations. Until I got the result I was looking for. It’s never fully precise you have to look at AI prompting like creative directing a photographer or videographer. There is going to be a little of their vision in whatever they produce sometimes it’s dead on and sometimes you wonder if they ever read the creative brief and hopefully its close enough to what you want. That’s AI prompting. It’s a tool not a magic bullet. It won’t do everything for you.
0 replies

Leave a Reply

Want to join the discussion?
Feel free to contribute!

Leave a Reply

Your email address will not be published. Required fields are marked *