In this example from PinkPantheress' at Coachella, once i had created and textured the rear of the taxi, a clean plate was shot inside UE5. Then, everything was brought together with the talent footage, and the lighting and background was seamlessly integrated via generative ai.
Example Workflow
Let's start with character sheets. Which are fairly vital for this workflow. You can even create environment sheets, but will will skip that for now. Something like this is plenty. It's an old drawing i made many years ago. Let's see what can be done with it.
Firstly, we don't want the cartoony style...
Some back and forth with prompting and a bit of Photoshop compositing, we have this.
After running a custom character sheet generator one time we have this. Looks decent for the first run, even if the belt doesn't make sense, we could fix that with PS, in-painting or further runs. Lets go with it for now.
We have provided the model a few images of the car and the environment. And of course our character sheet. A simple prompt to describe the action and camera cuts and we have this. It even gave us some fairly atmospheric sci-fi music. Not bad.
Up-scaling the latent images...
With a few extra nodes for latent up-scaling plus some added custom Lora's, 1080p, 10 second clips are possible locally. And they look pretty great if i say so myself.
Unusual methods for creative control...
Even with a bad drawing, we can achieve precise creative control with the placement of added objects.