Vision via sound for the blind

Around 39 million people worldwide are blind, according to the World Health Organisation, and an additional 246 million people live with low vision, impacting their ability to participate in everyday life activities.

The next generation smart glasses, which translate visual information into distinct sound icons, were developed by researchers from the University of Technology Sydney and the University of Sydney, together with Sydney start-up ARIA Research.

“Smart glasses typically use computer vision and other sensory information to translate the wearer’s surrounding into computer-synthesized speech,” said Distinguished Professor Chin-Teng Lin, a global leader in brain-computer interface research from the University of Technology Sydney.

“However, acoustic touch technology sonifies objects, creating unique sound representations as they enter the device’s field of view. For example, the sound of rustling leaves might signify a plant, or a buzzing sound might represent a mobile phone,” he said.

A study into the efficacy and usability of acoustic touch technology to assist people who are blind, led by Dr Howe Zhu from the University of Technology Sydney, has just been published in the journal PLOS ONE.

The researchers tested the device with 14 participants; seven individuals with blindness or low vision and seven blindfolded sighted individuals who served as a control group.

They found that the wearable device, equipped with acoustic touch technology, significantly enhanced the ability of blind or low-vision individuals to recognise and reach for objects, without causing too much mental effort.

“The auditory feedback empowers users to identify and reach for objects with remarkable accuracy,” said Dr Zhu. “Our findings indicate that acoustic touch has the potential to offer a wearable and effective method of sensory augmentation for the visually impaired community.”

The research underscores the importance of developing assistive technology in overcoming the challenges such as locating specific household items and personal belongings.

By addressing these day-to-day challenges, the acoustic touch technology opens new doors for individuals who are blind or have low vision, enhancing their independence and quality of life.

With ongoing advancements, the acoustic touch technology could become an integral part of assistive technologies, supporting individuals to access their environment more efficiently and effectively than ever before.