CineFX is a custom video-to-video workflow to create cinematic shots from home-shot footage.
Commercial AI video tools often fall short in one crucial aspect: providing precise control over the specific actions of characters in the video. This custom workflow solves it.
To test its limits, I chose to create an action sequence.
For inspiration, I saw tutorials from the amazing Mickmumpitz. I shot footage of myself playing both the characters.
The workflow uses open source generative AI models: CogVideoX, ControlNet and LivePortrait.
I setup cloud GPU instances to run this heavy workflow on ComfyUI. This is what it looks like inside comfyUI:
This experiment received a lot of love on X: