Cannes Lions

E-NTERPRETERS

FAHRENHEIT DDB, Lima / PILSEN CALLAO / 2022

Presentation Image
Presentation Image
Demo Film

Overview

Entries

Credits

Overview

Background

There are over 100 million deaf gamers in the world that are currenty missing the complete interactive gaming experience for not being able to hear; often opting to play alone. Many solutions have come up in other mediums and platforms, but none for communication between online game users; and as a result, this group of gamers are excluded from simple online conversations between friends.

That’s why this development combines artificial intelligence with sign language and integrates them in a bot inside Discord, the world’s largest communication platform for gamers, which now, when listening to each player’s voice, converts them into text commands and translates them to a visual response. Not so long ago, there were no available developments that could reduce the gap between gamers that are able to hear and deaf gamers in online games.

Idea

E-nterpreters is an AI bot that translates sign language conversations that occur in Discord, the world’s largest online gamer interaction platform, in real time. Partnered with Cyrcis’ technological labs, we summoned deaf gamers in order to learn gamer sign language so we could consolidate it into a universal language; creating specific translations for actions that didn’t have one yet.

Powered by Google’s artificial intelligence, bots listen to the conversations and translate them through avatars. An algorithm recognizes each player’s voice and translates it in the order they’re speaking. The goal is to transform the way deaf people communicate in the gaming world, by connecting them with gamers that are able to hear. An innovation that took 10 months of development and was certified by Discord as an official bot within the platform.

Strategy

The strategy was to address the entire deaf gamer community, thus, together, we created a new gamer sign language. To make it happen, we took advantage of a variety of technological tools that have been created to date to integrate them and generate an artificial intelligence that connects the entire gamer community with the rest of gamers. This took place within Discord, the communication tool par excellence to play online, that we decided to leave as an open source so it can be translated to other languages in the near future.

Execution

E-nterpreters is a bot that translates users’ conversations within Discord to sign language in real time. To achieve this, we integrated Google’s “speech to text” to our algorithm in order to convert texts into visual responses in any online game supported by this platform.

Currently, E-nterpreters is a bot verified by Discord, which allows us to start learning new languages in the medium term. For this, we plan to focus on the languages with the largest number of users (English, Japanese, Chinese, Korean), thus, accelerating the learning process.

E-nterpreters is an open source in development that’s looking forward to continuing with the inclusion of more signs and continuing the learning of more translations in real time.

Outcome

679,500 words translated in the first week

More than 4500 hours of the bot learning and counting

New languages such as English, Chinese, Japanese and Korean are under development.

Selected by Discord for its official bots list

28,367,711 impressions

Similar Campaigns

9 items

Stay Close From Far

PUBLICIS MIDDLE EAST, Dubai

Stay Close From Far

2021, NESCAFE

(opens in a new tab)