DirtyHarryLYL / Sandwich

Bidirectional Mapping between Action Physical-Semantic Space

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Sandwich

Bidirectional Mapping between Action Physical-Semantic Space

Maintained by Yong-Lu Li, Xiaoqian Wu, Xinpeng Liu, Yiming Dou, and Cewu Lu.

  • Pangea (CVPR 2024): Unified action semantic space (label system) tp aggregate all action datasets into ONE. Pangea

News: (2023.2.27) Pangea will appear at CVPR 2024!

Sandwich is a project for general human activity understanding. It consists of:

  • A novel structured semantic space to re-explain all the action classes from existing action datasets of multiple modalities.
  • A large-scale multi-modal action database, Pangea, aggregating a plenty of existing action datasets.
  • A bidirectional mapping system to learn the bi-mapping between human action physical-semantic space and facilitate the action recognition and generation.

We are gathering more and more human action datasets and linking their label systems to Pangea (CVPR 2024), for more details please refer to this page.

  • Given our new hierarchical semantic system, you can train big models on all action datasets under ONE label system with principled knowledge!

Under construction. More content is coming soon!

About

Bidirectional Mapping between Action Physical-Semantic Space

License:MIT License


Languages

Language:Jupyter Notebook 55.8%Language:Python 44.2%