Music Sync System

The What

TL;DR

For you to really appreciate it, I implore you to watch from the top. Otherwise skip to 2:20. The animation endpoint matches the BGM sting at 3:07.

The Why

Gameplay moments/climax that matches BGM beats in the most subtle and non-intrusive way, ’nuff said.

See how it can match anything with music. Animation beats, Hit landing moments, any background prop that moves, any niagara FX. it can even be used to achieve lightning fast workflow in cinematic sequencing as the audio takes care of itself.

All videos below lasts < 3 mins total.

The How

Simply, the essence of this lies in the algorithm that considers how much time the gameplay mechanic will take from now to reach the future hit point, how much time the BGM takes to hit the next targeted beat, the slope you’d like the ramp-up and ramp-down curve to have, and what percentage they’ll each take up in the whole thing (these are all tweakable). It also considers the max slowdown rate allowed by you, and calculates everything to come up with the ramp-up and ramp-down duration, and the time it will spend staying at the slowest point in the middle.

I’m not particularly a math genius, but this certainly made me feel like a mathematician solving the equation of the century.