This is a neural sign language translation reading list maintained by Xing Wang and Jinhui Ye
- Survey.
- Sign Language Gloss Translation.
- Two-stage Sign Language Translation.
- Gloss-based Sign Translation.
- Gloss-free Sign Translation.
- Dataset.
- Shared Task and Workshop.
- Sign Language Processing. Moryossef, Amit and Goldberg, Yoav. (2021)
- A survey on Sign Language machine translation. Adrián Núñez-Marcos, Olatz Perez-de-Viñaspre, Gorka Labaka. (Expert Systems with Applications 2022)
- Machine translation from signed to spoken languages: state of the art and challenges. Mathieu De Coster, Dimitar Shterionov, Mieke Van Herreweghe and Joni Dambre. (Universal Access in the Information Society 2023)
- Sign Language Translation: A Survey of Approaches and Techniques. Zeyu Liang, Huailing Li and Jianping Chai. (Electronics 2023)
- Data Augmentation for Sign Language Gloss Translation. Amit Moryossef, Kayo Yin, Graham Neubig, Yoav Goldberg. (AT4SSL 2021)
- Frozen Pretrained Transformers for Neural Sign Language Translation. Mathieu De Coster, Karel D’Oosterlinck, Marija Pizurica, Paloma Rabaey, Severine Verlinden, Mieke Van Herreweghe and Joni Dambre. (AT4SSL 2021) {code}
- Approaching Sign Language Gloss Translation as a Low-Resource Machine Translation Task. Xuan Zhang and Kevin Duh. (AT4SSL 2021)
- Using Neural Machine Translation Methods for Sign Language Translation. Galina Angelova, Eleftherios Avramidis, Sebastian Möller. (ACL SRW 2022) {code}
- Scaling Back-Translation with Domain Text Generation for Sign Language Gloss Translation. Jinhui Ye, Wenxiang Jiao, Xing Wang, Zhaopeng Tu. (EACL 2023) {code}
- Leveraging Large Language Models With Vocabulary Sharing For Sign Language Translation. Lee, Huije; Kim, Jung-Ho; Hwang, Eui Jun; Kim, (ICASSPW 2023).
- Neural Sign Language Translation Based on Human Keypoint Estimation. Sang-Ki Ko, Chang Jo Kim, Hyedong Jung and Choongsang Cho. (Applied Sciences, 2019)
- TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation. Dongxu Li, Chenchen Xu, Xin Yu, Kaihao Zhang, Benjamin Swift, Hanna Suominen, Hongdong Li. (NeurIPS 2020)
- Better Sign Language Translation with STMC-Transformer. Kayo Yin, Jesse Read. (COLING 2020)
- Improving Sign Language Translation with Monolingual Data by Sign Back-Translation. Hao Zhou, Wengang Zhou, Weizhen Qi, Junfu Pu, Houqiang Li. (CVPR 2021)
- Including Signed Languages in Natural Language Processing Kayo Yin, Amit Moryossef, Julie Hochgesang, Yoav Goldberg, Malihe Alikhani. (arXiv preprint 2021)
- Skeleton-Aware Neural Sign Language Translation. Shiwei Gan, Yafeng Yin, Zhiwei Jiang, Lei Xie, Sanglu Lu. (ACM MM 2021)
- WearSign: Pushing the Limit of Sign Language Translation Using Inertial and EMG Wearables. Qian Zhang, JiaZhen Jing, Dong Wang, Run Zhao. (ACM Interact. Mob. Wearable Ubiquitous Technol. 2022)
- Hierarchical LSTM for Sign Language Translation. Dan Guo, Wengang Zhou, Houqiang Li, Meng Wang. (AAAI 2018)
- Neural Sign Language Translation. Camgoz, Necati Cihan and Hadfield, Simon and Koller, Oscar and Ney, Hermann and Bowden, Richard. (CVPR 2018) {code}
- Connectionist Temporal Fusion for Sign Language Translation. Shuo Wang, Dan Guo, Wen-Gang Zhou, Zheng-Jun Zha, Meng Wang. ((ACM Multimedia 2018)
- Sign Language Transformers: Joint End-to-End Sign Language Recognition and Translation. Necati Cihan Camgoz, Oscar Koller, Simon Hadfield, Richard Bowden. (CVPR 2020) {code}
- SimulSLT: End-to-End Simultaneous Sign Language Translation. Aoxiong Yin, Zhou Zhao, Jinglin Liu, Weike Jin, Meng Zhang, Xingshan Zeng, Xiaofei He. (ACM MM 2021)
- Contrastive Disentangled Meta-Learning for Signer-Independent Sign Language Translation. Tao Jin, Zhou Zhao. (ACM MM 2021)
- Enhancing Neural Sign Language Translation by highlighting the facial expression information. Jiangbin Zheng, Yidong Chen, Chong Wu, Xiaodong Shi, Suhail Muhammad Kamal. (Neurocomputing 2021)
- Spatial-Temporal Multi-Cue Network for Sign Language Recognition and Translation. Hao Zhou, Wengang Zhou, Yun Zhou, Houqiang Li. (IEEE Transactions on Multimedia 2021)
- Prior Knowledge and Memory Enriched Transformer for Sign Language Translation. Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng. (Findings of ACL 2022)
- Two-Stream Network for Sign Language Recognition and Translation. Yutong Chen, Ronglai Zuo, Fangyun Wei, Yu Wu, Shujie Liu, Brian Mak. (NeurIPS 2022) {code}
- MC-SLT: Towards Low-Resource Signer-Adaptive Sign Language Translation Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng. (ACM MM 2022)
- A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation. Yutong Chen, Fangyun Wei, Xiao Sun, Zhirong Wu, Stephen Lin. (CVPR 2022) {code}
- MLSLT: Towards Multilingual Sign Language Translation. Aoxiong Yin, Zhou Zhao, Weike Jin, Meng Zhang, Xingshan Zeng, Xiaofei He. (CVPR 2022) {code}
- Sign Language Translation with Hierarchical Spatio-Temporal Graph Neural Network. Jichao Kan, Kun Hu, Markus Hagenbuchner, Ah Chung Tsoi, Mohammed Bennamounm, Zhiyong Wang. (CVPR 2022)
- Addressing Resource Scarcity across Sign Languages with Multilingual Pretraining and Unified-Vocabulary Datasets. NC Gokul, Manideep Ladi, Sumit Negi, Prem Selvaraj, Pratyush Kumar, Mitesh M Khapra. (NeurIPS 2022 Track Datasets and Benchmarks) {code}
- Graph-Based Multimodal Sequential Embedding for Sign Language Translation. Shengeng Tang, Dan Guo, Richang Hong, Meng Wang. (IEEE Transactions on Multimedia 2022)
- SLTUNET: A Simple Unified Model for Sign Language Translation. Biao Zhang, Mathias Müller, Rico Sennrich. (ICLR 2023) {code}
- Cross-modality Data Augmentation for End-to-End Sign Language Translation. Jinhui Ye, Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Hui Xiong. (Findings of EMNLP 2023) {code}
- Sign Language Translation with Iterative Prototype. Huijie Yao, Wengang Zhou, Hao Feng, Hezhen Hu, Hao Zhou, Houqiang Li. (ICCV 2023) {code}
- Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse. Ozge Mercanoglu Sincan, Necati Cihan Camgoz, Richard Bowden. (ICCV workshop 2023)
- A Token-Level Contrastive Framework for Sign Language Translation. Fu, Biao; Ye, Peigen; Zhang, Liang; Yu, Pei; Hu, Cong; Shi, Xiaodong; Chen, Yidong. (ICASSP 2023).
- Contrastive learning for sign language recognition and translation. Gan, Shiwei; Yin, Yafeng; Jiang, Zhiwei; Xia, Kang; Xie, Lei; Lu, Sanglu. (IJCAI 2023).
- Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining Benjia Zhou, Zhigang Chen, Albert Clapés, Jun Wan, Yanyan Liang, Sergio Escalera, Zhen Lei, Du Zhang. (ICCV 2023) {code}
- Gloss-Free End-to-End Sign Language Translation Lin, Kezhou and Wang, Xiaohan and Zhu, Linchao and Sun, Ke and Zhang, Bang and Yang, Yi. (ACL 2023) {code}
- Gloss Attention for Gloss-free Sign Language Translation Aoxiong Yin, Tianyun Zhong, Li Tang, Weike Jin, Tao Jin, Zhou Zhao. (CVPR 2023) {code}
- Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining. Zhou, Benjia; Chen, Zhigang; Clapés, Albert; Wan, Jun; Liang, Yanyan; Escalera, Sergio; Lei, Zhen; Zhang, Du. (ICCV 2023) {code}.
- Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation Ryan Wong, Necati Cihan Camgoz, Richard Bowden. (ICLR 2024)
- RWTH-PHOENIX-Weather 2014 T. Human Language Technology and Pattern Recognition Group at the RWTH Aachen University
- CSL-Daily Dataset. Visual Sign Language Research Group at the University of Science and Technology of China
- How2Sign Universitat Politecnica de Catalunya / Barcelona Supercomputing Center /Institut de Robotica i Informatica Industrial, CSIC-UPC / Carnegie Mellon University / Facebook AI / Gallaudet University
- BOBSL: BBC-Oxford British Sign Language Dataset. Visual Geometry Group at the University of Oxford
- YouTube-ASL. Google
- SignBank+ - Cleaning and Extending the SignBank Dataset. Bar-Ilan University / University of Zürich