Workflow - Add sound to any video (V2A foley with refiner)

#40
by RuneXX - opened

Original video (from Wan, Hunyuan etc - that does not have sound):

LTX-2 video to sound (and refine) :

Add sounds to your Wan videos - bring life into your old videos ;-)
You can prompt for ambient sound, background sound, action sound (car racing, explosions, etc etc), and even dialog (narrative)
https://huggingface.co/RuneXX/LTX-2-Workflows/blob/main/LTX-2%20-%20V2A%20Foley%20(add%20sound%20to%20any%20video).json

The background music sounds like stuttering πŸ€” i wondered whether we could upsample the audio too πŸ˜…

PS: Looks like there are a few audio upsampler custom nodes in Manager (i haven't tried them yet)

The more steps the better sound.
So for this type of generations, it might be wise to run Dev model with 20 steps and CFG 4 for the best quality

i love your work bro, legend

Original no-sound Wan video ( a random pick from CivitAI). And after LTX-2 video-to-audio.

Not quite Suno πŸ˜„ but not too bad hehe

Can easily via prompt add sound, sound fx, narrative dialog, music etc etc to any video you have rendered or render in Wan etc.
Since its aware of what is in your no-sound Wan video, it can match footsteps, explosions, ambient sound etc etc right on cue

Sign up or log in to comment