In the United States, close to 10M people are hearing impaired and 1M are functionally deaf. Yet access to American Sign Language (ASL) education is limited. 

At SXSW this year, we’re showcasing our unique AI-powered coffee ordering system, that challenges people to order their favorite brew using American Sign Language.

We first showcased this tool as “The ASL Alphabet Game” in December at NeurIPS, and decided to revamp its purpose at our Lab & Lounge experience at the Fairmont Austin, from March 8th-14thafter we caught wind that coffee can be hard to come by at the conference.

The technology uses Image and Video Understanding to teach users how to successfully sign a letter. The AI can recognize hand movements, and was trained by convolutional neural networks in a collection of more than 10,000 images to identify the correctness of gestures in real-time.

This coffee ordering system is part of our mission to create AI for Good, which stands for the development of Artificial Intelligence that improves the way we live, connect, and communicate. Where AI has the potential to make all people live a happier, more accessible life — Stradigi AI believes in it.

Considering that  83% of Americans identify as coffee drinkers, we’re expecting a busy six days at SXSW. 

Here’s a step-by-step guide on how to use our AI-powered coffee ordering system

Step 1: Order up   

Follow the screen and sign the first three letters of the coffee you’d like to order (for example, e-s-p for espresso).

Step 2: Got milk?

Let us know how you take your coffee by signing the first three letters of your choice: [r-e-g] for regular milk, [s-o-y] for soy milk, or [n-o-n] for no milk. Step 3: Ice or no ice  

Not much of a coffee fan? No worries, we’ve got water, too! Just sign [i-c-e] for ice or [n-o-n] for none to tell us how you’d like it.

Step 4: Confirm your order

Almost there! All that’s left is to confirm your order by signing [y] for yes if it’s right or [n] for no to start again.

Step 5: Enjoy a coffee on us

Congrats, you’ve successfully signed your way to a (free) coffee!

Swing by and visit us at the Fairmont Austin!

Our Lab & Lounge is on the 5th floor at the Fairmont. If you’re attending a talk on AI during the conference, chances are you’ll pass by our team on your journey. Come and sip on a coffee and talk about the Intelligent Future with us.

Don’t forget to snap a pic of your cup and tag @StradigiAI to join us in the #AIForGood movement.