ScrappyCocco / eXiSoundVis

UE4 Plugin that loads .ogg files at Runtime and analysis them to get the Frequency Spectrum and control gameplay stuff with that data.

Scrappy note

This plugin was useful to analyze audio frequency spectrum.

With Unreal 4.22 they introduced "Spectral Analyzer" so this plugin is no longer necessary.

This repository has been archieved on 24 June 2019.

eXiSoundVis

^{Note: The image above is an animated GIF, so there's some quality lost. Please see the YouTube video for higher quality visualization of Disclosure's You and Me.}

This is an Unreal Engine 4 plugin that loads .ogg files at runtime and analyzes them to get the frequency spectrum to control gameplay, visualization and more.

Feature list and pictures of available nodes:

• Load .ogg file from HDD
• Load sound names and file paths from HDD to display list of sound
• Get frequency spectrum of a loaded Sound
• Get specific frequency values by using the calculated frequency spectrum
• Start/Pause/Resume/Stop your Sound and Frequency Calculation through the build in Player

Installation

Unzip the package into the Plugins directory of your game. To add it as an engine plugin you will need to unzip the module into the plugin directory under where you installed UE4.

1. Download the ZIP File.

2. Create a Plugins folder in your game or engine directory and extract the plugin into it. It should look something like this:

3. Open your project (and/or regenerate the Visual Studio files to have the plugin in your solution) and enable it in the plugin section:

4. To use the Plugin, add the SoundVisComponent to the Actor of your choice, which comes with the plugin:

5. Load a sound via its ABSOLUTE path (only .ogg files). The Component has a Delegate | OnFileLoadCompleted, which gets called and passes the complete USoundWave Reference, once the process is over (ASYNC)!:

5.1 NEVER CLOSE THE PROJECT WHILE LOADING A SOUND!

6. Use the Calculate Frequency Spectrum function after you loaded a sound to get an Array of Frequency Values, which represents the Frequencies from 0 to ~22000hz:

6.1 THIS ONLY WORKS WITH LOADED AND DECOMPRESSED .ogg FILES!

7. Since this only analyzes one small segment of the Sound and we don't want ugly Delay-Loops, use these functions to Start/Pause/Resume/Stop the whole sound (will also play it!)

7.1 The analyzed Frequency Spectrum will be returned via a second Delegate | OnFrequencySpectrumCalculated, which also comes with the Component.

8. Now you can use the different frequency functions to get the values (for example if you want to get the values for bass, use 20 to 60 for SubBass and 60 to 250 for Bass. You can look up more on the internet.

11. You can find all functions available by going to the SoundVis category. They are explained in the SoundVisComponent.h if you don't know how to use them:

When cooking, make sure to add the plugin to your projects dependencies!

License, Credits, Contacts and more...

See original repo