SignGT is an AI-powered sign language recognition and translation system that uses computer vision and machine learning techniques to detect hand gestures and convert them into meaningful text in real time. The project aims to bridge the communication gap between people who use sign language and those who do not.
- Real-time sign language detection
- Gesture recognition using computer vision
- Translation of signs into text
- User-friendly interface
- Extensible architecture for adding new signs and languages
- Efficient preprocessing and prediction pipeline
- Programming Language: Python
- Machine Learning: TensorFlow / PyTorch
- Computer Vision: OpenCV, MediaPipe
- Frontend: Streamlit / Flask (if applicable)
- Data Processing: NumPy, Pandas
- Visualization: Matplotlib
SignGT/
├── dataset/ # Training and testing datasets
├── models/ # Trained model files
├── notebooks/ # Jupyter notebooks for experiments
├── src/
│ ├── preprocessing.py
│ ├── train.py
│ ├── predict.py
│ └── utils.py
├── app.py # Main application
├── requirements.txt
├── README.md
└── LICENSEgit clone https://github.com/your-username/SignGT.git
cd SignGTpython -m venv venvActivate it:
Windows
venv\Scripts\activateLinux/macOS
source venv/bin/activatepip install -r requirements.txtpython app.pyIf using Streamlit:
streamlit run app.py- Capture hand gestures using a webcam.
- Extract hand landmarks using MediaPipe/OpenCV.
- Preprocess the extracted features.
- Feed the features into the trained model.
- Convert predictions into readable text.
The model is trained on a dataset containing images/videos of sign language gestures.
Dataset includes:
- Hand gesture images
- Landmark coordinates
- Corresponding labels
Replace this section with details about your dataset source and size.
| Metric | Value |
|---|---|
| Accuracy | 74% |
| Precision | 68% |
- Support for complete sentence generation
- Multi-language sign recognition
- Speech synthesis from predicted text
- Mobile application deployment
- Improved model accuracy with larger datasets
Contributions are welcome!
- Fork the repository
- Create a new branch
- Commit your changes
- Push to your branch
- Open a Pull Request
This project is licensed under the MIT License.
Kamakshi Mudgal