Digital Craft > Technology

DOT GO. THE FIRST CUSTOMIZABLE OBJECT RECOGNITION APP FOR THE VISUALLY IMPAIRED

SERVICEPLAN GERMANY, Munchen / DOT / 2021

Awards:

Bronze Cannes Lions
CampaignCampaignLayout(opens in a new tab)
Demo Film
Supporting Images
Supporting Images

Overview

Credits

Overview

Describe the creative idea

As a blind and visually impaired person it’s challenging to live an active, independent lifestyle. Camera-based assistive technology can help, however existing solutions are limiting: They all rely on proprietary data and closed systems, designed for fixed use cases rather than increasing user needs. This leads to fragmentation and increasingly expensive technology.

Dot Go solves this by leveraging open-source object recognition models, including those of other solutions, together with new LiDAR integration in iPhone. This allows anyone to customize presets for specific objects, locations and needs, creating a growing library of use cases curated by users, institutions, and brands.

Designed to work as an accessibility tool kit, Dot Go empowers users to create custom presets without coding knowledge: By connecting any object – from people and vehicles to signage and equipment – with unique sound, haptic and visual feedback, and trigger automations on external devices, smart home applications and online.

Describe the execution

Dot Go uses the latest LiDAR integration in iPhone to detect and measure precise distance to any object and trigger an action upon detection. Following the simple material conditional logic used in programming – “if x then y” – Dot Go allows users to create on a simple principle: Any object can connect with any action.

Unlike existing solutions that rely on proprietary databases, Dot Go leverages open-source object recognition models, including those of other solutions, making the app as accurate as all existing solutions combined, while enabling customization for specific user needs.

The same customization principle is applied to preset creation: Instead of fixed use cases, anyone can create presets for specific objects, locations and needs. This allows a growing library of use cases curated by users, institutions, and brands. Most importantly, it enables the visually impaired community to engage more with their environment and experience it in their own way.

To enhance usability and performance Dot Go works with, but is not limited to, accessories like the lanyard or active shirt for handsfree use. A Pocket Mode helps conserve energy by turning off the display while a double and triple back tap feature allows the user to switch easily between presets.

In March 2020, prototype development of Dot Go was started. Since January 2021, a beta version of Dot Go is underway of testing by users worldwide through the Apple TestFlight program.

More Entries from Innovative Use of Technology in Digital Craft

24 items

Gold Cannes Lions
DRAWN CLOSER

Motion Graphics Design & Animation

DRAWN CLOSER

COX COMMUNICATIONS, COX COMMUNICATIONS

(opens in a new tab)

More Entries from SERVICEPLAN GERMANY

24 items

Gold Cannes Lions
PARKDISTANCECONTROL

Automotive

PARKDISTANCECONTROL

MINI, SERVICEPLAN GERMANY

(opens in a new tab)