Augmented reality facilitates augmentative and alternative communication

Many people living in Finland face language and communication challenges that impact their daily lives. These problems affect a large group and can be caused by conditions such as aphasia, autism spectrum disorder or intellectual disabilities.  

A team of researchers at Tampere University launched a two-year study titled “Augmentative and Alternative Communication Reality” in August 2024. Funded by the Jane and Aatos Erkko Foundation, this study addresses the challenges of augmentative and alternative communication (AAC) with the help of technology.   

Augmented reality holds promise to revolutionise AAC

The new study is led by Associate Professor Johanna Virkki and focuses on AAC methods that either support or replace verbal communication. These methods range from no-tech options, such as communication boards, to assistive technologies, such as speech-generating devices.

The researchers seek to achieve a major breakthrough in AAC development by harnessing the potential of augmented reality. 

“Augmented reality is poised to become a groundbreaking technology in AAC. The goal of our study is to create a framework for developing augmented reality-assisted AAC,” Virkki says.

Augmented reality could provide users with on-demand support tailored to their current situation or environment, such as images, text, videos, and 3D models. In addition, their communication partners could receive tailored content to further support the ongoing interaction.

Hands-on involvement from experts by experience 

AAC methods have conventionally been designed and developed by people who do not have language or communication challenges. As a result, these methods may not necessarily meet users’ needs and instead force them to adapt to the demands of assistive technology.

In the Tampere University study, people living with aphasia, autism spectrum disorder or an intellectual disability will assume the role of experts by experience in AAC development. 

The researchers will immerse themselves in the daily lives of people with language and communication challenges and observe their everyday communications first-hand. Despite difficulties with language or social interaction, these experts by experience will serve as specialists of their own communication. They will provide researchers with unique insights that are beyond the reach of traditional data collection methods. 

In addition to Associate Professor Johanna Virkki, the participants of the study include Anni Raukko and Jaana Mäkinen, who work as interpreters for people with language and communication difficulties, and speech therapist Tanja Vihriälä.