ControlNet / emolysis

[ACII Demo] Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit

Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit

This repo is official repository for the paper Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit.

Get Started

We provided a static demo review for you to try. Please visit https://emolysis.controlnet.space/local/1.

If you want to analyze your own video, please follow the instructions below to deploy the server.

Deploy the Server

From Docker (x86 with CUDA)

Requires:

• Docker
• nvidia-docker

Run the server.

docker run --runtime nvidia -p <PORT>:8000 [-v <CACHE_DIR_FOR_MODELS>:/app/checkpoints] --name emolysis controlnet/emolysis

Then, you can access the app at http://127.0.0.1:<PORT>.

From Source

Requires:

• Conda
• Node.js

Install dependencies.

npm install
npm run build
cd service
bash -i build_env.sh  # use `build_env.mac.sh` for arm-based mac
conda activate emolysis
cd ..

Run the server.

python service/main.py --port <PORT>

Then, you can access the app at http://127.0.0.1:<PORT>.

References

If you find this work useful for your research, please consider citing it.

@inproceedings{ghosh2024emolysis,
  title={Emolysis: A multimodal open-source group emotion analysis and visualization toolkit},
  author={Ghosh, Shreya and Cai, Zhixi and Gupta, Parul and Sharma, Garima and Dhall, Abhinav and Hayat, Munawar and Gedeon, Tom},
  booktitle={2024 12th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)},
  pages={116--118},
  year={2024},
  organization={IEEE}
}