As a blind and visually impaired person it’s challenging to live an active, independent lifestyle. Camera-based assistive technology can help, however existing solutions are limiting: They all rely on proprietary data and closed systems, designed for fixed use cases rather than increasing user needs. This leads to fragmentation and makes solutions increasingly expensive, forcing users to choose between adaptability and their individual needs.

Dot Go is designed to work as an accessibility tool kit. It empowers users to create custom presets without coding knowledge. It allows them to connect any object – from people and vehicles to signage and equipment – with unique sound, haptic and visual feedback, and trigger automations on external devices, smart home applications and online.

As a blind and visually impaired person it’s challenging to live an active, independent lifestyle. Camera-based assistive technology can help, however existing solutions are limiting: They all rely on proprietary data and closed systems, designed for fixed use cases rather than increasing user needs. This leads to fragmentation and increasingly expensive technology.

Dot Go solves this by leveraging open-source object recognition models, including those of other solutions, together with new LiDAR integration in iPhone. This allows anyone to customize presets for specific objects, locations and needs, creating a growing library of use cases curated by users, institutions, and brands.

Designed to work as an accessibility tool kit, Dot Go empowers users to create custom presets without coding knowledge: By connecting any object – from people and vehicles to signage and equipment – with unique sound, haptic and visual feedback, and trigger automations on external devices, smart home applications and online.

Dot Go is set to be the first in a new category of accessible, adaptable and hands-free solutions for the blind and visually impaired. For the first time, an assistive application is leveraging the power of open-source object recognition models together with LiDAR integration in iPhone.

This open-source approach allows a growing library of use cases curated by users, public institutions, and brands. Most importantly, it enables the visually impaired community to engage more with the world around them and experience it in their own way.

In March 2020, prototype development of Dot Go was started. Since January 2021, a beta version of Dot Go is underway of testing by users worldwide through the Apple TestFlight program.

Dot Go uses the latest LiDAR integration in iPhone to detect and measure precise distance to any object and trigger an action upon detection. Following the simple material conditional logic used in programming – “if x then y” – Dot Go allows users to create on a simple principle: Any object can connect with any action.

Unlike existing solutions that rely on proprietary databases, Dot Go leverages open-source object recognition models, including those of other solutions, making the app as accurate as all existing solutions combined, while enabling customization for specific user needs.

The same customization principle is applied to preset creation: Instead of fixed use cases, anyone can create presets for specific objects, locations and needs. This allows a growing library of use cases curated by users, institutions, and brands. Most importantly, it enables the visually impaired community to engage more with their environment and experience it in their own way.

To enhance usability and performance Dot Go works with, but is not limited to, accessories like the lanyard or active shirt for handsfree use. A Pocket Mode helps conserve energy by turning off the display while a double and triple back tap feature allows the user to switch easily between presets.

In March 2020, prototype development of Dot Go was started. Since January 2021, a beta version of Dot Go is underway of testing by users worldwide through the Apple TestFlight program.