‘Using technology for the greater good is what UNIT9 excels at. This project was a great opportunity to help those on the Autism spectrum to improve communication skills, learn micro-expressions, social cues and the nuances of conversation with faster response times. If we can help any person on the Autism spectrum to have a better video call user experience then we will rise to the challenge.’
The background
Ahead of International Autism Day on April 4, Cox wanted to empower those on the autism spectrum to develop more meaningful connections online. So we created a tool that enabled them to have better, deeper conversations with their loved ones.
The execution
Project Convey is a video chat prototype designed to help people on the autism spectrum better identify non-verbal social cues. It recognizes an emotion on someone’s face and translates it into an emoji, allowing someone with autism to better understand the emotions and nuances of the conversation.
Our team used AI cloud services like IBM Watson to analyze both facial and verbal expressions in real-time. Using pitch analysis and speech-to-text allowed us to interpret someone’s verbal expression sentiment and the emotion behind their words. And interpreting facial expressions, particularly facial micro-expressions, helped capture the sentiment behind what they were saying.
The results
With the release of the prototype coinciding with International Autism Day, the response has been overwhelmingly positive. It’s amazing to be able to use technology to make real connections and bring people closer together, and we loved seeing the joy it brought to those with autism of all ages.
Credits
-
Division
-
Directors
-
Agency
-
Brand
-
Conception Creative Director
-
Conception Creative Director
-
Conception Creative Director
-
Platform
-
Kind
-
Industry
-
Release Date
2022-03-21
