Align videos with audio analysis & stack them in a multi sound file

With align-videos-by-sound, which is a python script/application you can align videos by their sound tracks.

After install, you can for example do this:

./bin/simple_stack_videos_by_sound_track --mode=direct --audio_mode=multi_streams tests/testfiles/3-secs-in.mp4 tests/testfiles/7-secs-in.mp4 tests/testfiles/full.mp4

It will present the 3 videos stacked in a "merged.mkv" file (one of the videos will be duplicated for symmetry), and the sound tracks from all 3 videos will be synced, for editing and mixing in e.g. Audacity (tested by me).

Click to view full-size image… — Size: 80.3 kB

This is what it looks like in Audacity when you open the "merged.mkv" file. You can then export to multiple files and they will get the appropriate length of silence in the beginning.

Align-videos-by-sound is alpha software! And I am the maintainer of it, although all the heavy coding was done by Allison Deal (where i lifted the code from) and later Hiroaki Itoh.