In the United States, close to 10M people are hearing impaired and 1M are functionally deaf. Yet access to American Sign Language (ASL) education is limited. 

At South by Southwest (SXSW) 2019, we showcased our unique AI-powered coffee ordering system, which challenged people to order their favorite brew using American Sign Language.

We first showcased this tool as “The ASL Alphabet Game” in December at NeurIPS, and decided to revamp its purpose at ourLab & Lounge experience at the Fairmont Austin, from March 8th-14thafter we caught wind that coffee can be hard to come by at the conference.

The technology uses Image and Video Understanding to teach users how to successfully sign a letter. The AI can recognize hand movements, and was trained by convolutional neural networks in a collection of more than 10,000 images to identify the correctness of gestures in real-time.

This coffee ordering system is part of our mission to create AI for Good, which stands for the development of Artificial Intelligence that improves the way we live, connect, and communicate. Where AI has the potential to make all people live a happier, more accessible life — Stradigi AI believes in it.

Considering that  83% of Americans identify as coffee drinkers, we’re expecting a busy six days at SXSW. 

Here’s a step-by-step guide on how to use our AI-powered coffee ordering system

Step 1: Order up   

Follow the screen and sign the first three letters of the coffee you’d like to order (for example, e-s-p for espresso).

Step 2: Got milk?

Let us know how you take your coffee by signing the first three letters of your choice: [r-e-g] for regular milk, [s-o-y] for soy milk, or [n-o-n] for no milk. Step 3: Ice or no ice  

Not much of a coffee fan? No worries, we’ve got water, too! Just sign [i-c-e] for ice or [n-o-n] for none to tell us how you’d like it.

Step 4: Confirm your order

Almost there! All that’s left is to confirm your order by signing [y] for yes if it’s right or [n] for no to start again.

Step 5: Enjoy a coffee on us

Congrats, you’ve successfully signed your way to a (free) coffee!

 

For more information on Stradigi AI and our ML solution, Kepler, visit our platform page here.