Auditory and Visual Sensations

Professor Yoichi Ando, acoustic architectural designer of the Kirishima International Concert Hall in Japan, presents a comprehensive rational-scientific approach to designing performance spaces. His theory is based on systematic psychoacoustical observations of spatial hearing and listener preferences, whose neuronal correlates are observed in the neurophysiology of the human brain. A correlation-based model of neuronal signal processing in the central auditory system is proposed in which temporal sensations (pitch, timbre, loudness, duration) are represented by an internal auorrelation representation, and spatial sensations (sound location, size, diffuseness related to envelopment) are represented by an internal interaural crosscorrelation function. Together these two internal central auditory representations account for the basic auditory qualities that are relevant for listening to music and speech in indoor performance spaces. Observed psychological and neurophysiological commonalities between auditory and visual sensations and preference patterns are presented and discussed. This book thus spans the disciplines of physics, acoustics, psychology, neurophysiology, and music production, thereby blending science, engineering, and art.

The subject of the book is the grounding of architectural acoustics in psychophysics (perception, listener preferences) and neuroscience (auditory function, neural correlates of perception and preference). This is the first rational-scientific approach to designing performance spaces that is based on systematic psychoacoustical observations of spatial hearing and listener preferences. Observations of the neuronal correlates of auditory qualities and listener preferences ground the theory of listener preferences in the neurophysiology of the human brain. A correlation-based model of neuronal signal processing in the central auditory system is proposed. Observed psychological and neurophysiological commonalities between auditory and visual sensations and preference patterns are presented and discussed. This book thus spans the disciplines of physics, acoustics, psychology, neurophysiology, and music production, thereby blending science and art.

Temporal and spatial sensations. Temporal auditory sensations include auditory qualities such as pitch, timbre, loudness, and duration, which are modeled using features extracted from the temporal autocorrelation function (ACF) of the sound. Neuronal responses related to these qualities are mainly associated with left hemisphere auditory regions of cerebral cortex. Spatial auditory sensations include the perceived direction of sound, its apparent size (apparent source width, ASW) and its subjective diffuseness deeply related to envelopment. These spatial aspects of sound perception are extracted from the interaural crosscorrelation function (IACF), which takes into account the differences in the sounds that reach the two ears. Cortical neuronal responses related to spatial hearing are mainly associated with auditory regions in the right hemisphere.

Thus, the "primary sensation" evoked by a sound in some space can be divided into two categories: temporal sensations and spatial sensations. Any other subjective responses of the source sound signal and the sound field can be described in terms of temporal and spatial factors. Part I of the book describes experimental results from basic research in acoustics, psychoacoustics, the psychology of auditory preferences, and auditory neurophysiology. Applications include optimal design of concert hall and opera house acoustics, architectural acoustics of speech intelligibility and musical expression, as well as the perception of noise and its annoyance.

In Part II, temporal and spatial sensations in vision are described in terms of similar kinds of correlation-based representations. A seamless, general theory can be established for temporal and spatial aspects of vision that includes subjective preferences for visual environments. Many audio-visual analogies are drawn. A typical temporal sensation of vision is the "pitch" of a flickering light, for which the missing fundamental is perceived in a manner highly analogous to its acoustic counterpart. Visual spatial sensations include contrast, regularity and coarseness. A spatial "vibrato" in a drawing is demonstrated as an application of the theory in the visual arts.

The reader is given a highly fleshed out strategy for architectural acoustical design that is grounded both in psychology and neuroscience. Few other works are as ambitious in attempting to understand and explain such a wide range of perceptual phenomena. This human-centered design approach can be applied to any design practice in which the goal is to optimize the experience of the design product by its users. The proposed theory shows how a unified science of human perceptual experience and preference might be both possible and useful.

Yoichi Ando is an expert in the areas of concert hall acoustics architectural acoustics, brain activities, and environmental design. He has been awarded the AIA Institute Honor, American Institute of Architects in 1995: For 30 years of work developing and applying new theories of concert hall acoustics have helped the way music is heard. A scientist, author, and educator, his achievements are a benefit to both the world of architecture and the world of music. He has also been awarded the "Laurea Honoris Causa" (Dottore ad Honorem) by University of Ferrara, Italy on 12 June 2002, and serves as Editor-In-Chief, of the Journal of Temporal Design in Architecture and the Environment.

Peter Cariani works in the fields of auditory neurophysiology; temporal coding of pitch, timbre, and consonance; neural networks for temporal processing; music perception and cognition.