Best ControlNET uses

How can we control our creative work.

Author

Nejc Susec
January 16, 2024

Hello My Friend

ControlNET has been around for a while now (coming up to a year). It’s one of the major AI features when it comes to image (and subsequently video) generation. With a reason. It offers a level of control (it’s in the name after all) over our creative work.

I want to highlight three use cases today, that transform your creative work.

I teach how to use ControlNET (among other lessons) in my latest course, if you want to learn step by step. You can use the code “2024” for 50% off.

ControlNET

Use an image to drive our AI generations.

First one are compositions. By drawing our composition (by hand, finding reference) we can use AI to build on top of that.

As in this example using a spiral composition:

Here are a few more examples:

Nejc Susec on LinkedIn: #midjourney #aiart #artificialinspiration #aicc_io #aicccreators…

Adding design principles to AI workflows. Have you heard of the golden ration? The Fibonacci spiral? I bet you have. Have you tried using it with AI…

www.linkedin.com/posts/nejcsusec_midjourney-aiart-artificialinspiration-activity-7110080277464457216-TTyN?utm_source=share&utm_medium=member_desktop

Second are "Images inside Images.”

We can use text, logo, faces, paintings… as guidance and generate on top of them with AI.

An example with Mona Lisa:

Few more examples here:

Nejc Susec on LinkedIn: #midjourney #aiart #stablediffusion #aicc #aicccreators

Art is all around us. Hidden in plain sight. Sometimes literally. 😁 ControlNET is still the best feature when it comes to creating intentional images with…

www.linkedin.com/posts/nejcsusec_midjourney-aiart-stablediffusion-activity-7115516193305763840-aBIg?utm_source=share&utm_medium=member_desktop

ControlNET + IP Adapter

We can use ControlNET for the composition and IP adapter for the subject/prompt.

With this combination, we can put characters into specific scenes.

As seen in this example:

+

Result

Few more examples here:

Nejc Susec on LinkedIn: #aiart #aiforgood #aistorytelling #invokeai #stablediffusion #mijdourney…

Alright, alright. I know your mind is blown by all the crazy developments and new features that come out daily. I'm also sure you're eager to play around…

www.linkedin.com/posts/nejcsusec_aiart-aiforgood-aistorytelling-activity-7133001522476453888-TqHL?utm_source=share&utm_medium=member_desktop

ControlNET + Animate Diffusion

Video is a sequence of images and as such, we can use ControlNET to keep the movement consistent

Here are two examples:

Nejc Susec on LinkedIn: #ai #aiart #stablediffusion #animatediffusion #controlnet | 17 comments

I don't usually post other people's work, but with the amount of incredible things I see everyday, I can't resist to not post some of them. AnimateDiffusion +… | 17 comments on LinkedIn

www.linkedin.com/posts/nejcsusec_ai-aiart-stablediffusion-activity-7122039110432673792-xDnp?utm_source=share&utm_medium=member_desktop

Nejc Susec on LinkedIn: #aiart #aiforgood #aistorytelling #stablediffusion #midjourney #aicc… | 39 comments

New tools unlock new ways of creating. Animate Diff + ControlNET is a sandbox to play in and discover. What would you create with it? Video credits:… | 39 comments on LinkedIn

www.linkedin.com/posts/nejcsusec_aiart-aiforgood-aistorytelling-activity-7140611370466652160-YmUk?utm_source=share&utm_medium=member_desktop

We started with text prompts and now we’ve been adding more and more controls beyond that.

The future of AI is multimodal, we need to look beyond text-only prompts.

Whenever you’re ready, here are 4 ways I can help you:

If you like my work, consider sharing it with others. It helps me inspire and empower more people.

As a thank you, you’ll get one of the downloadables as a gift. 💛