DFKI Team on Sign Language

VideoProcessingTools

A set of command-line tools to preprocess videos for sign language analysis

gloss-to-text-sign-language-translation

Pre-processing and execution scripts for experiments on automatic translation of sign language focusing on the gloss-to-text. Research done in the frame of the bachelor's thesis of Galina Angelova, supported by the BMBF-funded project SocialWear

text-to-gloss-sign-language-translation

Code collections for sign language text-to-gloss translation. Research done in the frame of the master thesis as well as ACL'23 publication of Dele Zhu, supported by the BMBF-funded project SocialWear

slt

Extensions of the code from the Univ. of Surrey (Sign Language Transformers (CVPR'20) in order to reproduce state-of-the-art experiments on machine translation of sign language in a GPU cluster and support 3D geometric augmentation of body keypoints

Transfer-ShapeKeys-Via-UV-Blender-Addon

A Blender add-on to transfer ShapeKeys between objects using compatible UV maps for vertex matching.

RecSyncNG

Video recording app with sub-millisecond synchronization accuracy for multiple Android smartphones, useful for creating affordable and easy-to-setup multi-view camera systems for robotics, SLAM, 3D-reconstruction, panorama stitching.

SignLanguageDatasetTools

Appraise

Appraise code used as part of WMT-SLT22 human evaluation campaign

AVASAG

EASIER-EkmanClassifier

Ekman facial expression classifier trained on affect net and tuned & tested for videos containing Sign Language.

EASIER-EmotionAnalysis

Scripts for the annotation and clustering of emotions in sign language datasets

FER-for-sign-language

Code for reproducing the experiments of the SLTAT-2022 paper on fine-tuning of convolutional neural networks for the recognition of facial expressions in sign language video samples

sl-animation-blender

A project where motion capture data is created based on the AI solution MediaPipe Holistic and applied to a 3D character in Blender

sl-roleplay-unity

HoloLens Application with a scripted 3D sign language avatar

WMT-SLT22

wmt-slt22-findings

Evaluation of the first shared task for machine translation of sign language