Upcoming AI tools

Animation and 3D turned on it's head.

Author

Nejc Susec
February 27, 2023 • Estimated Reading Time: 3 minutes

Hello Master Mavens.

I always dreamt of making my own animated series. Which is not an easy feat to do. Especially by yourself, without dozens of people working on it.

AI is fundamentally changing how we create and soon, making an animated series by yourself will not be such an outrageous thought.

I’ve done a lot of research into upcoming technologies that affect 2D and 3D animation and want to share some of them with you.

This is the next level photoscanning. Photoscanning allows us to take photos and reassemble them into a 3D model. Pretty cool. These models can be used in any 3D workflow, BUT you still need to set the scene with lighting and reflections.

Enter Neural Radiance Field (NeRF), which predicts how the object (model would look like from different angles and creates reflections accordingly.

If you want to test it out, download the Luma AI app on your phone, take some photos and see them recreated in 3D.

Ever wanted to make 3D animations from video footage? Well, it’s become as easy as uploading it to a website, which tracks your shot and generates a 3D animation.

Another option is Kinetix.

If you’ve ever animated anything, you know that animating characters and especially faces, is a BIG task. There are so many tiny muscles in our face, which help us express our emotions.

Nvidia is making this easier with audio to face. By uploading an audio, AI automatically matches the tone of the voice and adjust the facial expressions accordingly.

You can create a digital avatar with your likeness and voice. Instead of filming yourself, you can type in text and have an avatar act the scene out for you.

People are already making animations with Stable Diffusion and it’s only going to get more exciting.

There are many more tools and a lot are experimental. Test them out, find your own use cases for them.

If you have thoughts on this topic, hit reply and send me a message, I would love to chat. 🤗

In Collaboration with the WWF, the AICC community is reimaging a world without nature.

It’s a great opportunity to put your AI image creation to the test and showcase your work on global scale.

You can also stop by my website or social media and as always,

Keep creating and don’t forget to have fun. ☀