CineFX: CINEMATIC AI WORKFLOW
🤖

CineFX: CINEMATIC AI WORKFLOW

CineFX is a custom video-to-video workflow to create cinematic shots from home-shot footage.

Commercial AI video tools often fall short in one crucial aspect: providing precise control over the specific actions of characters in the video. This custom workflow solves it.

To test its limits, I chose to create an action sequence.

For inspiration, I saw tutorials from the amazing Mickmumpitz. I shot footage of myself playing both the characters.

The workflow uses open source generative AI models: CogVideoX, ControlNet and LivePortrait.

I setup cloud GPU instances to run this heavy workflow on ComfyUI. This is what it looks like inside comfyUI:

image
image

This experiment received a lot of love on X: