Fingerspelling.xyz is a browser-based app that uses a webcam and machine learning to analyze your hand shapes so you can learn to sign the ASL alphabet correctly.

To start, you are given a series of words and the computer shows you a 3D model of how your hand should be positioned for each letter. When you sign the word, the camera tracks your hand movements and gives you feedback so you can make corrections as needed. This helps you quickly develop your fingerspelling skills and move to the next level of the program.

The site uses advanced hand tracking coupled with a detection script that can translate the hand and finger positions to ASL Fingerspelling signs. Through AR we overlay the AI / Machine Learning data - and match that with the Fingerspelling detection to see if there is a match and thereby create a unique and extremely innovative way of teaching Fingerspelling. Eventhough it is highly advanced, the user interaction is seamless and feels natural. So you can focus on learning.

From a design perspective, the goal was to communicate fingerspelling in the cleanest and most simple way possible. Therefore, the 3D-hand is placed prominently in the center of the site and paired with a playful typeface. Its angled glyphs have a dynamic movement that mirrors subtle visual nuances in the hand gestures, and the slightly off-kilter appearance feels joyful and engaging.

In regards to color, the aim was to use a palette that was bold enough to draw people in and, at the same time, energize them to start learning to fingerspell. Capturing attention was key.

The 3D hand was designed to feel friendly, with enough detail for users to be able to easily see how the fingers are positioned and bent. A blend of cartoon style and realism was the perfect solution.

Fingerspelling is a great way to introduce the basics of ASL in a fun and playful way. Instead of having to read or watch videos about fingerspelling, we offer an online teaching tool that guides you step by step in how to master fingerspelling - hands on. The game is designed for desktop, primarily to be used by parents for deaf children, but kids will also find it a fun way to practice and improve their fingerspelling technique.

Fingerspelling is an essential part of ASL, the primary language of the Deaf community. It is often used for proper nouns or to sign a word you don’t know the sign for.