ryanwongsa / Sign2GPT

[ICLR2024] Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation

Implementation of Sign2GPT.

[19/07/2024] Added missing transformer encoder modules.

[02/06/2024] Added spatial model architecture setup.

[25/05/2024] Added sign encoder model architecture setup.

[07/04/2024] Created Repo for the paper titled "Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation", Work in progress with the aim to start releasing code once I have completed the release for Learnt Contrastive Concept Embeddings for Sign Recognition (See repo for latest updates)

About

[ICLR2024] Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation

License:Apache License 2.0


Languages

Language:Python 100.0%