Painting by Numbers with AI
I've been experimenting with various AI tools this week and found my way to Stable Diffusion on Google Colab where I've been mostly banging my head against the wall.
However, after a little perseverance and patience, I managed to feed something that I've shot into an AI system and get something out the other side which is more or less what I wanted. I was aiming for a simple painted style that resembled the original footage and very clearly wasn't a cheap 'paint effect' plugin that you get in edit or VFX applications.
Each frame (well in this case, every other frame) is analysed and regenerated in a painted style, driven by prompts. These 'prompts' are guide words for the AI and can include a description of the subject, the style, colour, effects or anything else really. It's a bit experimental and can produce amazing results.
I'm interested to see how this process might lead to some interesting visual effects for my clients. I'll be spending a little more time on this over the next couple of weeks and I'll stick a few example up here as I go, see if I can see any improvement in my skills!
Comments