Innovation > Innovation

E-NTERPRETERS

FAHRENHEIT DDB, Lima / PILSEN CALLAO / 2022

Awards:

Shortlisted Cannes Lions
CampaignCampaign(opens in a new tab)
Presentation Image
Case Film

Overview

Credits

Overview

Why is this work relevant for Innovation?

E-nterpreters is a development that changes the way in which deaf people communicate in online games completely. By integrating them into a socialization space they were missing due to not being able to hear. Before E-nterpreters, deaf gamers missed commands, instructions and even simple conversations that are part of the essence of online gaming. Now, you can open Discord and start observing what other players are saying in real time.

Background

There are over 100 million deaf gamers in the world that are currenty missing the complete interactive gaming experience for not being able to hear; often opting to play alone. Many solutions have come up in other mediums and platforms, but none for communication between online game users; and as a result, this group of gamers are excluded from simple online conversations between friends.

That’s why this development combines artificial intelligence with sign language and integrates them in a bot inside Discord, the world’s largest communication platform for gamers, which now, when listening to each player’s voice, converts them into text commands and translates them to a visual response. Not so long ago, there were no available developments that could reduce the gap between gamers that are able to hear and deaf gamers in online games.

Describe the idea

E-nterpreters is an AI bot that translates sign language conversations that occur in Discord, the world’s largest online gamer interaction platform, in real time. Partnered with Cyrcis’ technological labs, we summoned deaf gamers in order to learn gamer sign language so we could consolidate it into a universal language; creating specific translations for actions that didn’t have one yet.

Powered by Google’s artificial intelligence, bots listen to the conversations and translate them through avatars. An algorithm recognizes each player’s voice and translates it in the order they’re speaking. The goal is to transform the way deaf people communicate in the gaming world, by connecting them with gamers that are able to hear.

An innovation that took 10 months of development and was certified by Discord as an official bot within the platform.

What were the key dates in the development process?

Please include a timeline of the details and dates. (e.g. 3 November 2017 - First patent agreed)

Jun 12 – Oct 15, 2020: Research of technology

Oct 20 – Nov 5, 2020: Research of the community

Oct 20 – Nov 19, 2020: Concept Art

Nov 12, 2020: Motion Capture

Nov 20 – Dic 12 2020: Unity, and Discord

Feb 20, 2020: E-nterpreters Final Test

March 22, 2020: Launch Day

Describe the innovation / technology

E-nterpreters is a bot that translates users’ conversations within Discord to sign language in real time. To achieve this, we integrated Google’s “speech to text” to our algorithm in order to convert texts into visual responses in any online game supported by this platform.

Currently, this development is available only for PC within Discord. E-nterpreters is as an open source in development that’s looking forward to continuing with the inclusion of more signs and the learning of more translations in real time.

Describe the expectations / outcome

Currently, E-nterpreters is a bot verified by Discord, which allows us to start learning new languages in the medium term. For this, we plan to focus on the languages with the largest number of users (English, Japanese, Chinese, Korean), thus, accelerating the learning process.

The programming is open so that any developer in the world can improve the AI and integrate more signs within the library of gestures in our programming.

More Entries from Applied Innovation in Innovation

24 items

Grand Prix Cannes Lions
ONE HOUSE TO SAVE MANY

Product Innovation

ONE HOUSE TO SAVE MANY

SUNCORP GROUP, LEO BURNETT

(opens in a new tab)

More Entries from FAHRENHEIT DDB

24 items

Gold Cannes Lions
PERUSSIAN PRICES

Retail

PERUSSIAN PRICES

PLAZA VEA, FAHRENHEIT DDB

(opens in a new tab)