Mobile > Apps & Games

EYEDAR

AREA 23, AN IPG HEALTH NETWORK COMPANY, New York / HORIZON THERAPEUTICS / 2022

Awards:

Silver Cannes Lions
CampaignCampaign(opens in a new tab)
Supporting Images
Supporting Images
Supporting Images

Overview

Credits

Overview

Background

Horizon is a healthcare company that manufactures multiple treatments, including for two diseases that can cause blindness. But their commitment to their patients expands beyond preventing vision loss to include sponsoring and supporting accessibility solutions for anyone who is blind or visually impaired.

Echolocation is a powerful visualization tool for the blind. It’s a form of sensory substitution using clicking sounds that bounce off surfaces to map one’s surroundings. Inspired by the life-changing power of echolocation and determined to change the fact that only 1% of the blind can echolocate, we created Eyedar.

In 2020 when LiDAR, a 3D scanning technology, became standard hardware feature of iPhones, the potential to make echolocation-like skills accessible became a reality. Combining this technology with the fundamentals of echolocation, we set out to bring this life-changing skill to the world.

Describe the creative idea

Eyedar is the first app that teaches the blind to visualize their world with sound. It was inspired by echolocation—a form of sensory substitution where the blind use the sense of hearing to visualize their surroundings.

Eyedar digitizes the principles of echolocation, making it an accessible and learnable skill. By leveraging the newly available LiDAR 3D technology in iPhones, Eyedar maps a user’s environment and translates it into 3D audio data, allowing the blind to visualize their surroundings. Changes in pitch, volume, and spatial sound convey information on the size, shape, distance, and direction of objects.

Eyedar provides sequential training, beginning with basic sound and obstacle recognition, and progressively challenging users to visualize more complex soundscapes and navigate their environment with greater confidence. Over time, the process is designed to become second nature and allow users to build a clearer picture of the world around them.

Describe the strategy

For Eyedar to live up to its enormous potential, it needed to demonstrate an understanding of a blind person’s needs, habits, and challenges. To that end, Horizon consulted and partnered with blind users from the very beginning, including those experienced with echlocation.

As the needs of the blind are often misunderstood by sighted designers and developers, Eyedar was designed by a blind-led UX team. The team built the app with universal best practices of accessibility design and took a blind-first approach. This meant eliminating a visual interface and exclusively using voice commands and gestures to navigate the Eyedar app.

As we progress, the input of users will be vital for further development, allowing for the app to grow ever more useful for the blind population.

Describe the execution

Eyedar emits a LiDAR signal from a user’s iPhone, creating a 3D-map of their surroundings. A 100-point vertical line array sweeps from left to right across the LiDAR field, and each point is assigned a pitch tone from low to high, bottom to top. As the line sweeps the field, each point emits its assigned tone, with higher (close) or lower (distant) volume depending on proximity to the user. The result is, to the untrained ear, a lot of noise. But with practice and training, the mind becomes accustomed to the noise, patterns begin to emerge, and a clearer mental picture of the world is achievable.

Several prior fMRI studies have shown that with visual-audio sensory substitution, and with echolocation specifically, it is the brain’s visual cortex which processes the information, leading to a “vision-like experience” in practitioners of echolocation.

List the results

Eyedar has the potential to redefine what it means to be blind. Echolocation has already shown how it can positively impact the lives of those who use it, and the only impediment to widespread adoption is the accessibility to learning the skill. Eyedar removes that barrier.

Eyedar is available for free in the app store and its open-sourced design allows for continued innovation and customization to best benefit the blind community. The app works with LiDAR-compatible phones, including the iPhone 12 and 13 (Pro and Max Pro). As LiDAR and other computer vision technology become standard on phones, it will become even more accessible. With about 50 million blind people in the world, Eyedar can reach an unprecedented proportion to make echolocation a learnable and accessible skill.

More Entries from Utility Apps in Mobile

24 items

Grand Prix Cannes Lions
REAL TONE — PRODUCT INNOVATION & GLOBAL CAMPAIGN

Advanced Learning Technologies

REAL TONE — PRODUCT INNOVATION & GLOBAL CAMPAIGN

GOOGLE, GOOGLE

(opens in a new tab)

More Entries from AREA 23, AN IPG HEALTH NETWORK COMPANY

24 items

Shortlisted Cannes Lions
FREE KILLER TAN

Education & Awareness

FREE KILLER TAN

MOLLIE BIGGANE MELANOMA FOUNDATION (MOLLIES FUND), AREA 23

(opens in a new tab)