fc4ae42290.gif

This workflow makes use of infinite mask dilations to create stunning video animations. Transform your subject (dancer) and give them a dynamic audioreactive background made of dilating masks, or create a custom dilation schedule using the custom scheduling node. You can use this workflow with single or multiple subjects.

SBSInfiniteAudioreactiveDilations.mp4

How to use:

  1. Upload a subject video in the Input section
  2. Select the desired width and height of the final video, along with how many frames of the input video should be skipped with “every_nth”. You can also limit the total number of frames to render with “frame_load_cap”.
  3. Fill out the positive and negative prompt. Set batch frame times to match when you’d like the scene transitions to occur.
  4. Upload images for each of the default IP Adapter subject mask colors:
    1. Red, Green, Blue = subject(s)
    2. Black, White = Dilation mask colors, only uses 1 reference image per mask
    3. Yellow multi, Magenta multi = Dilation mask colors, enables AK IPAdapter Custom Weights to allow transitioning between multiple reference images over time. Takes more VRAM due to using 2 IPAs per mask.
  5. Load a good LCM checkpoint (I use ParadigmLCM by Machine Delusions) in the “Models” section.
    1. Add any loras using the Lora stacker below the model loader
  6. Hit Queue Prompt

Video Guide

https://youtu.be/MqdH8sYFZNo

Node and Group Color