Engineering

Neuroscience

Audio visual

Sound (geography)

Computer science

Acoustics

Soundscape

Mechanical engineering

Physics

Psychology

Blueprint

Perception

Human–computer interaction

Multimedia

Applied Acoustics

The sense of sight or 'visual' plays a crucial role in the perception of soundscape. Since the concept of soundscape is put forward, audio-visual interaction has been incorporated in soundscape research, particularly in urban planning and noise control. The study on audio-visual interactions have not only enhanced and expanded the contents of soundscape assessment, but also helped to develop more comprehensive approaches for the recording and reproduction of audio-visual signals. This paper aims to evaluate the effects of audio-visual interactions on soundscape assessment and noise control through an extensive review of existing literatures. Methodologies of in situ surveys and laboratory experiments are summarized and discussed, which allows a classification system and conceptual framework for soundscape study and design with audio-visual interaction to be constructed. Accordingly, this framework can provide a guideline for the methodologies to be used in future audio-visual assessments of soundscapes and blueprint for how an audio-visual experiment should be designed.

A review of audio-visual interaction on soundscape assessment in urban built environments