Scrappy note
This plugin was useful to analyze audio frequency spectrum.
With Unreal 4.22 they introduced "Spectral Analyzer" so this plugin is no longer necessary.
This repository has been archieved on 24 June 2019.
eXiSoundVis
Note: The image above is an animated GIF, so there's some quality lost. Please see the YouTube video for higher quality visualization of Disclosure's You and Me.
This is an Unreal Engine 4 plugin that loads .ogg
files at runtime and analyzes them to get the frequency spectrum to control gameplay, visualization and more.
Feature list and pictures of available nodes:
- Load
.ogg
file from HDD - Load sound names and file paths from HDD to display list of sound
- Get frequency spectrum of a loaded Sound
- Get specific frequency values by using the calculated frequency spectrum
- Start/Pause/Resume/Stop your Sound and Frequency Calculation through the build in Player
Installation
Unzip the package into the Plugins directory of your game. To add it as an engine plugin you will need to unzip the module into the plugin directory under where you installed UE4.
1. Download the ZIP File.
2. Create a Plugins
folder in your game or engine directory and extract the plugin into it. It should look something like this:
3. Open your project (and/or regenerate the Visual Studio files to have the plugin in your solution) and enable it in the plugin section:
4. To use the Plugin, add the SoundVisComponent
to the Actor of your choice, which comes with the plugin:
5. Load a sound via its ABSOLUTE path (only .ogg
files). The Component has a Delegate | OnFileLoadCompleted
, which gets called and passes the complete USoundWave
Reference, once the process is over (ASYNC)!:
5.1 NEVER CLOSE THE PROJECT WHILE LOADING A SOUND!
6. Use the Calculate Frequency Spectrum function after you loaded a sound to get an Array of Frequency Values
, which represents the Frequencies from 0 to ~22000hz:
6.1 THIS ONLY WORKS WITH LOADED AND DECOMPRESSED .ogg FILES!
7. Since this only analyzes one small segment of the Sound and we don't want ugly Delay-Loops
, use these functions to Start/Pause/Resume/Stop the whole sound (will also play it!)
7.1 The analyzed Frequency Spectrum will be returned via a second Delegate | OnFrequencySpectrumCalculated
, which also comes with the Component.
8. Now you can use the different frequency functions to get the values (for example if you want to get the values for bass, use 20 to 60 for SubBass and 60 to 250 for Bass. You can look up more on the internet.
11. You can find all functions available by going to the SoundVis category. They are explained in the SoundVisComponent.h
if you don't know how to use them:
When cooking, make sure to add the plugin to your projects dependencies!