Researchers develop new methods to enhance film experience for visually impaired audiences

Posted on 1 November 2021

Researchers at the University of York have developed a new way for visually impaired audiences to experience and enjoy films.

The Immersive Audio Dome at the University of York Audiolab is key to developing the 3D audio strategy. Credit: University of York/Department of Theatre, Film, Television and Interactive Media

Traditional Audio Description (AD) consists of an audio track in the third person that provides information on the visual layer of a film or television programme. The current use of traditional AD can sometimes overlap with other sound elements in the soundtrack, such as music and sound effects.

Under the new format, verbal descriptions are minimised and sound design is used as the main vehicle for accessibility, through a combination of additional sound effects, 3D sound, and first-person narration.

Inclusive

Back in 2016, the researchers conducted a survey which found that 34% of visually impaired people surveyed had not attended the cinema in the previous 12 months, compared to only 5.5% of sighted people surveyed, with issues of accessibility discouraging visually impaired people from attending.

The new methods result in a more “organic” form of accessibility which will help bring about a more inclusive cinematic experience.

The University of York project, which was funded by the UK Arts and Humanities Research Council, sought to provide an alternative soundtrack that minimised the number of verbal descriptions and, as a result, avoid them masking crucial elements in the original soundtrack.

Accessible experiences

The project favoured the creation of accessible experiences through sound design strategies by focusing on three main techniques.

The first method is the addition of sound effects to provide information on actions, elicit the presence of establishing shots, convey abstract scenes as well as indicate the presence of characters, time and place. The second method is the use of 3D sound over headphones to allow the conveyance of the position of characters and objects portrayed on the screen. Finally, the use of first-person narration to portray aspects of the story that cannot be conveyed through sound effects, such as feelings, gestures, colours as well as certain actions.

'Pearl'

The effectiveness of these new techniques was explored through a case study, the short film Pearl, which was conducted in collaboration with students of the University. The film focuses on a young girl called Margaret, who has the ability to produce pearls. The cinematography works on darkness and shadows and the production design looks to generate ambiguity by blending Victorian Gothic horror elements with contemporary ones.

The film was chosen as a case study due to the research team’s initial involvement as advisors to the production as well as its unusual storyline.

The study team consulted widely and held a series of focus groups with visually impaired and sighted audiences to demonstrate the potential of these techniques to foster inclusive cinematic experiences.

Creative sound design

Dr Mariana Lopez, Senior Lecturer in Sound Production and Post Production in the Department of Theatre, Film, Television and Interactive Media, said: “We have sought to create a new paradigm for accessibility to film and television by shifting the focus from verbal descriptions to the power of creative sound design and the importance of incorporating accessibility to the creative filmmaking workflows.

“By designing such works, sound can be a vehicle for social inclusion by making cinematic experiences shared accessible experiences.”