My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

AnimateDiffLightning Differential Diffusion V2V

1.0

1 reviews
2
904
271
1
Description

Based on the sampling principles from "Differential Diffusion Animation Raw & Background Changer" workflow, this workflow differs in:

1. Reduced lots of nodes and refiner, removed all Set/Get nodes.

2. Uses AnimateDiffLightning to reduce 15 steps to 8 steps.

AnimateDiffLightning:

3. Maintains stable background and subject sampling from original workflow.

4. Uses RMBG 2.0 for subject/background separation, all nodes updated to new versions.

Operational nodes:

1. Res: Controls output resolution

2. Value1 and Value2: Control denoising levels for subject (Value1) and background (Value2). Without Controlnet control for background, higher background values cause more flickering. Subject values at 1.0 maximize prompt adherence with greater character changes.

3. Extraprompt: Defaults to prompting from original video frames; when enabled, allows custom prompting.

==

For custom prompts, enable ExtraPrompt and input through Prompt.

Choose any preferred SD1.5 model as Checkpoint.

For V2V effects demonstration, refer to the video generated using this workflow by setting subject denoise to 1.0 (same source video as Differential Diffusion Animation Raw & Background Changer).

Discussion

(No comments yet)

Loading...

Author

61
111.9K
1.8K
428.0K

No reviews yet

  • - latest (5 months ago)

Primitive Nodes (9)

ACN_AdvancedControlNetApply_v2 (2)

DownloadAndLoadFlorence2Model (1)

Florence2Run (1)

RMBG (1)

SimpleCondition+ (1)

SimpleMathBoolean+ (1)

SimpleMathDual+ (1)

SimpleMathInt+ (1)

Custom Nodes (30)

AnimateDiff Evolved

  • - CheckpointLoaderSimpleWithNoiseSelect (1)

  • - ADE_AnimateDiffUniformContextOptions (1)

  • - ADE_ApplyAnimateDiffModelSimple (1)

  • - ADE_UseEvolvedSampling (1)

  • - ADE_LoadAnimateDiffModel (1)

ComfyUI

  • - VAELoader (1)

  • - ControlNetLoader (2)

  • - KSampler (1)

  • - CLIPTextEncode (2)

  • - VAEDecode (1)

  • - FreeU_V2 (1)

  • - DifferentialDiffusion (1)

  • - MaskToImage (1)

  • - ImageCompositeMasked (1)

  • - SetLatentNoiseMask (1)

  • - VAEEncode (1)

  • - ImageBlur (1)

  • - ImageToMask (1)

  • - ImageFromBatch (1)

  • - ImageResize+ (1)

  • - DepthAnythingPreprocessor (1)

  • - VHS_VideoCombine (1)

  • - VHS_LoadVideo (1)

  • - AnyLineArtPreprocessor_aux (1)

  • - RemapImageRange (2)

  • - Text Multiline (1)

Checkpoints (1)

darkSushiMixMix_225D.safetensors

LoRAs (0)