Wearables with Real-Time 3D Technology Create New Way of Sensing by Translating Visual Information
In cooperation with the CDTM institute of the Technical University of Munich (TUM), FRAMOS® has developed an innovative wearable using real-time 3D technology to support visually impaired people in daily life. The glasses are equipped with the latest Intel® RealSense™ stereo cameras, intelligent algorithms translate the visual impression into haptic and audio information. While audio information relies on object and character recognition, the haptic feedback is provided by a wrist band equipped with vibration motors. This new way of sensing enables visually impaired people to fully understand their environment and to have advanced guidance for safe navigation.
The eye is probably the most important human sense. But visual information is hidden for 108 million visually impaired people worldwide. Shop names, street names, route numbers of public transport or traffic signs are invisible, navigation without this information is a true challenge. The FRAMOS developed glasses now represent a new possibility for the visually impaired to explore the surrounding benefitting from the latest technology.
Dr. Christopher Scheubel, FRAMOS Business Development: We are proud having found a way to bring state-of-art technology into an application, which provides a huge impact on the daily life of the visually impaired. This project hits the sense of innovation by really supporting humans and improving their lives. The exceptional beauty of this technology is the ability to provide visual information normally given by the human eye. Our technology creates a new way of sensing.
The 3D enabled wearable creates a new way of sensing by translating visual information into haptic feedback on a wristband in real-time. The prototype includes an Intel® RealSense™ 3D camera and speakers for audio feedback. The setup is controlled by a processing hub with a GPS sensor and a LTE module for mobile data connection. Connected via Bluetooth, a micro-processing unit translates visual data into haptic-feedback through an 2D array of vibration motors. Based on the exact location and movement of the vibrating feedback on the arm, the visually impaired is informed about the position and distance of things in the surroundings. A voice controlled interface makes interaction easy and rechargeable batteries enable a full day of use.
The glasses are a smart assistant helping the visually impaired to master their life and provides a new level of safety and knowledge by text and object recognition enabled with intelligent algorithms. The prototype leverages state-of-the-art vision technology and entirely reflects FRAMOS’ mission of making machines to see and think.
With over 37 years of experience, FRAMOS is in tune with today’s imaging requirements and positioned to help clients innovate and remain competitive by developing cutting-edge vision solutions. As a global imaging partner, FRAMOS can support with a broad solution portfolio that ranges from sensors to systems and value-added service in every stage of the imaging solutions value chain.
