Cristand / SiamBOMB

SiamBOMB: Siamese network using Background information for real-time Online Multi-species home-cage animal Behavioral analysis. (Updating)

SiamBOMB

This repo is the third preview version of SiamBOMB, which wil be updated until the end of 2021.
Team of MiRA, Institute of Automation, CAS. All rights reserved.

Introduction

Our Paper (IJCAI 2020 Demo Track): 10.24963/ijcai.2020/776

Setup

1. Configure environments

TODO

conda create -n SiamBOMB python=3.7
conda activate SiamBOMB

2. Install dependencies

TODO

pip install --upgrade SiamBOMB

3. Equip models

Automatically, (with gdown from Google Drive)

python -m SiamBOMB.downloader

Or manually,

• SiamMask_E pretrained model: Google Drive, Baidu Pan (jffj)
  into pysot/experiments/siammaske_r50_l3/model.pth
• KYS pretrained model: Google Drive, Baidu Pan (bf3u)
  into pytracking/networks/kys.pth
• LWL pretrained model: Google Drive, Baidu Pan (w244)
  into pytracking/networks/lwl_boxinit.pth
• KeepTrack pretrained model: Google Drive, Baidu Pan (g92v)
  into pytracking/networks/keep_track.pth
  and its base model: Google Drive, Baidu Pan (zylv)
  into pytracking/networks/super_dimp_simple.pth

You can download several of them on demand.

Demonstration

TODO

python -m SiamBOMB.launcher

Citation

@inproceedings{SiamBOMB,
  title     = {SiamBOMB: A Real-time AI-based System for Home-cage Animal Tracking, Segmentation and Behavioral Analysis},
  author    = {Chen, Xi and Zhai, Hao and Liu, Danqian and Li, Weifu and Ding, Chaoyue and Xie, Qiwei and Han, Hua},
  booktitle = {Proceedings of the Twenty-Ninth International Joint Conference on
               Artificial Intelligence, {IJCAI-20}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},             
  pages     = {5300--5302},
  year      = {2020},
  month     = {7},
  doi       = {10.24963/ijcai.2020/776},
  url       = {https://doi.org/10.24963/ijcai.2020/776},
}

References

@article{A_Common_Hub,
  title={A common hub for sleep and motor control in the substantia nigra},
  author={Liu, Danqian and Li, Weifu and Ma, Chenyan and Zheng, Weitong and Yao, Yuanyuan and Tso, Chak Foon and Zhong, Peng and Chen, Xi and Song, Jun Ho and Choi, Woochul and others},
  journal={Science},
  volume={367},
  number={6476},
  pages={440--445},
  year={2020},
  publisher={American Association for the Advancement of Science}
}