ysjprojects / SIGNify

An application that empowers the deaf community by simulating a natural conversation using CV and NLP technologies.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

SIGNify

Overview of Application


SIGNify is an AI-powered app for the hearing impaired, as part of the National AI Student Challenge 2023. SIGNify is free and utilises cutting-edge technology for real-time ASL-to-text translation, grammatical correction, and sentiment analysis. Our goal is to make a positive impact on the hearing impaired community.

Project Demo Link


https://www.youtube.com/watch?v=ncwKXnMxhLA

Project Description


American Sign Language (ASL) is the primary form of communication for individuals who are deaf and hard of hearing (D&M). This is because their only communication-related disability is an inability to use spoken language, and thus they rely solely on sign language to communicate.

The main focus of this project is to create a model that can accurately recognize hand gestures used in fingerspelling, with the ultimate goal of forming complete words by combining each individual gesture.

The gestures that were trained for this project are depicted in the image provided below.

Alternate image text


Here is a short demonstration of tha application:

animated


Libraries Requirements -(Requires the latest pip version to install all the packages)



1.Lastest pip -> pip install --upgrade pip

2.opencv -> pip install opencv-python

3.tkinter -> pip install tk

4.customtinkter -> pip install customtkinter 

5.opencv -> pip install opencv-python

6.numpy -> pip install numpy

7.os-sys -> pip install os-sys

8.happytransformer -> pip install happytransformer

9.sgnlp -> pip install sgnlp

10.tensorFlow -> pip install tensorflow 

11.peekingduck -> pip install peekingduck

12.pyttsx3 -> pip install pyttsx3

13.gTTS -> pip install gTTS

14.playsound -> pip install playsound

15.speechRecognition -> pip3 install SpeechRecognition pydub

16.rapid automatic keyword extraction algorithm -> pip install rake-nltk

17.natural language toolkit -> pip install nltk

Running the Project


python /path/to/the/Root.py

About

An application that empowers the deaf community by simulating a natural conversation using CV and NLP technologies.


Languages

Language:Jupyter Notebook 98.9%Language:Python 1.1%