Using augmented reality to make community spaces accessible for children with autism spectrum disorder

The app, named MuseGO, maps out the indoor environment according to sensory criteria, such as noise level, lighting and temperature
MuseGO maps out the indoor environment according to sensory criteria, such as noise level, lighting and temperature

July 29, 2019

Amanda Hacio

A team of three U of T graduate students has designed an app for caregivers that can help improve the accessibility of museums for children with autism spectrum disorder (ASD). The innovation earned them third place at the 2019 Universities Canada Innovative Designs for Accessibility (IDeA) student competition.

IDeA is a national competition that aims to inspire university students to develop innovative, cost-effective and practical solutions to everyday accessibility-related barriers. For their entry, Keren He (ECE MEng 1T9), Christina Park (MI MMSt 1T9) and Yifan Zhang (ECE MEng 1T9) decided to focus on the barriers faced by children with ASD when visiting community spaces such as museums.

Children with ASD can experience sensory defensive challenges, meaning they have a low threshold for response to stimuli and tend to avoid certain kinds of sensory input. However, some children with ASD experience the opposite, referred to as sensory seeking challenges, meaning that they have a high threshold for response to stimuli and tend to seek out extra sensory input.

The app, named MuseGO, maps out the indoor environment according to sensory criteria, such as noise level, lighting and temperature. The virtual map then informs an augmented reality interface that places icons on the screen describing sensory experiences visitors can expect to find in each area.

This additional information helps visitors decide whether to avoid or visit certain areas. By making sensory information visible, the app improves overall guest experience, minimizing stress, exhaustion and confusion.

“MuseGO was inspired by a guest speaker in a Museum Studies course I took at the Faculty of Information,” says Park. “The speaker discussed their institution’s sensory-friendly programming, so we decided to explore the potential of using a personal mobile device as a tool to break barriers for children diagnosed with ASD in accessing cultural institutions as well as other community spaces such as universities, hospitals, libraries, museums, and shopping malls.”

Park took the idea to Creative Applications for Mobile Devices (ECE 1778H). In this course, taught by Professor Jonathan Rose, students work in multidisciplinary teams to design and develop smartphone apps for a wide range of uses. By the end of the semester, He, Park and Yang had a working prototype of MuseGO.

After completing the course, the team decided to pit their creation against 55 other projects in the national IDeA competition. Their third-place finish in the attitudinal/system barriers category comes with a $1,000 prize. They were also encouraged by the positive feedback they received from the IDeA judges, industry and peers.

“It’s been very rewarding to have put our learning and skills together to create this app which has been recognized by the greater community,” says Zhang. “We’re currently working on improving the technical and design aspects of the app to create more intuitive and accurate indoor navigation. On-site user testing in public spaces is one of our key next steps.”

This story originally appeared in U of T Engineering News.

More information:
Jessica MacInnis
Senior Communications Officer
The Edward S. Rogers Sr. Department of Electrical & Computer Engineering
416-978-7997; jessica.macinnis@utoronto.ca