Purdue University Graduate School
Thesis_American Sign Language Translation using YOLOv3.pdf (1.68 MB)

You Only Gesture Once (YouGo): American Sign Language Translation using YOLOv3

Download (1.68 MB)
posted on 2020-05-01, 17:52 authored by Mehul NandaMehul Nanda
The study focused on creating and proposing a model that could accurately and precisely predict the occurrence of an American Sign Language gesture for an alphabet in the English Language
using the You Only Look Once (YOLOv3) Algorithm. The training dataset used for this study was custom created and was further divided into clusters based on the uniqueness of the ASL sign.
Three diverse clusters were created. Each cluster was trained with the network known as darknet. Testing was conducted using images and videos for fully trained models of each cluster and
Average Precision for each alphabet in each cluster and Mean Average Precision for each cluster was noted. In addition, a Word Builder script was created. This script combined the trained models, of all 3 clusters, to create a comprehensive system that would create words when the trained models were supplied
with images of alphabets in the English language as depicted in ASL.


Degree Type

  • Master of Science


  • Computer and Information Technology

Campus location

  • West Lafayette

Advisor/Supervisor/Committee Chair

Dr. Dmitri Gusev

Additional Committee Member 2

Dr. John Springer

Additional Committee Member 3

Dr. Chad Laux