
This workflow makes use of infinite mask dilations to create stunning video animations. Transform your subject (dancer) and give them a dynamic audioreactive background made of dilating masks, or create a custom dilation schedule using the custom scheduling node. You can use this workflow with single or multiple subjects.
SBSInfiniteAudioreactiveDilations.mp4
How to use:
- Upload a subject video in the Input section
- Select the desired width and height of the final video, along with how many frames of the input video should be skipped with “every_nth”. You can also limit the total number of frames to render with “frame_load_cap”.
- Fill out the positive and negative prompt. Set batch frame times to match when you’d like the scene transitions to occur.
- Upload images for each of the default IP Adapter subject mask colors:
- Red, Green, Blue = subject(s)
- Black, White = Dilation mask colors, only uses 1 reference image per mask
- Yellow multi, Magenta multi = Dilation mask colors, enables AK IPAdapter Custom Weights to allow transitioning between multiple reference images over time. Takes more VRAM due to using 2 IPAs per mask.
- Load a good LCM checkpoint (I use ParadigmLCM by Machine Delusions) in the “Models” section.
- Add any loras using the Lora stacker below the model loader
- Hit Queue Prompt
Video Guide
https://youtu.be/MqdH8sYFZNo
Node and Group Color