Jacob Benesty

Jingdong Chen

Gongping Huang

Ningning Pan

This book explains the motivation for using microphone arrays as opposed to using a single sensor for sound acquisition. The book then goes on to summarize the most useful ideas, concepts, results, and new algorithms therein. The material presented in this work includes analysis of the advantages of using microphone arrays, including dimensionality reduction to remove the redundancy while preserving the variability of the array signals using the principal component analysis (PCA). The authors also discuss benefits such as beamforming with low-rank approximations, fixed, adaptive, and robust distortionless beamforming, differential beamforming, and a new form of binaural beamforming that takes advantage of both beamforming and human binaural hearing properties to improve speech intelligibility. The book makes the microphone array signal processing theory and applications available in a complete and self-contained text. The authors attempt to explain the main ideas in a clear and rigorous way so that the reader can easily capture the potentials, opportunities, challenges, and limitations of microphone array signal processing. This book is written for those who work on the topics of microphone arrays, noise reduction, speech enhancement, speech communication, and human-machine speech interfaces.

Microphone Arrays

Mads G. Christensen

Jesper R. Jensen

This book introduces readers to the novel concept of variable span speech enhancement filters, and demonstrates how it can be used for effective noise reduction in various ways. Further, the book provides the accompanying Matlab code, allowing readers to easily implement the main ideas discussed. Variable span filters combine the ideas of optimal linear filters with those of subspace methods, as they involve the joint diagonalization of the correlation matrices of the desired signal and the noise. The book shows how some well-known filter designs, e.g. the minimum distortion, maximum signal-to-noise ratio, Wiener, and tradeoff filters (including their new generalizations) can be obtained using the variable span filter framework. It then illustrates how the variable span filters can be applied in various contexts, namely in single-channel STFT-based enhancement, in multichannel enhancement in both the time and STFT domains, and, lastly, in time-domain binaural enhancement. In these contexts, the properties of these filters are analyzed in terms of their noise reduction capabilities and desired signal distortion, and the analyses are validated and further explored in simulations.

Signal Enhancement with Variable Span Linear Filters

Israel Cohen

The focus of this book is on array processing and beamforming with Kronecker products. It considers a large family of sensor arrays that allow the steering vector to be decomposed as a Kronecker product of two steering vectors of smaller virtual arrays. Instead of directly designing a global beamformer for the original array, once the steering vector has been decomposed, smaller virtual beamformers are designed and separately optimized for each virtual array. This means the matrices that need to be inverted are smaller, which increases the robustness of the beamformers, and reduces the size of the observations. The book explains how to perform beamforming with Kronecker product filters using an unconventional approach. It shows how the Kronecker product formulation can be used to derive fixed, adaptive, and differential beamformers with remarkable flexibility. Furthermore, it demonstrates how fixed and adaptive beamformers can be intelligently combined, optimally exploiting the advantages of both. The problem of spatiotemporal signal enhancement is also addressed, and readers will learn how to perform Kronecker product filtering in this context.

Kronecker Product Beamforming

Array Processing

Constantin Paleologu

Tomas Gänsler

Silviu Ciochină

Single-channel hands-free teleconferencing systems are becoming popular. In order to enhance the communication quality of these systems, more and more stereophonic sound devices with two loudspeakers and two microphones are deployed. Because of the coupling between loudspeakers and microphones, there may be strong echoes, which make real-time communication very difficult. The best way we know to cancel these echoes is via a stereo acoustic echo canceller (SAEC), which can be modelled as a two-input/two-output system with real random variables. In this work, the authors recast this problem into a single-input/single-output system with complex random variables thanks to the widely linear model. From this new convenient formulation, they re-derive the most important aspects of a SAEC, including identification of the echo paths with adaptive filters, double-talk detection, and suppression.

A Perspective on Stereophonic Acoustic Echo Cancellation

This book studies the link between differential beamforming and differential equations which in turn enables the study of fundamental theory and methods of beamforming from a different perspective, leading to new insights into the problem and new methods to solve the problem. The book first presents a brief overview of the problems and methods for beamforming and some performance measures popularly used either to evaluate beamformers or to derive optimal beamformers. Then, first-order, second-order, and general high-order linear difference equations are discussed, based on which the authors show how to formulate the beamforming problem and derive different beamforming methods, including fixed and adaptive ones. Furthermore, the authors show how to apply the theory of difference equations to the general problem of speech enhancement, and deduce a number of noise reduction filters, including the maximum SNR filter, the Wiener filter, the MVDR filter, etc. Also covered in the book are the difference equations and differential beamforming from the spectral graph perspective. Presents basic concepts, fundamental principles, and methods for beamforming from the perspective of linear difference equations; Provides formulation and methods of conventional beamforming, and first-order, second-order, and general high-order linear difference equations for beamforming; Includes the applications of linear difference equations to the problem of noise reduction; Explains beamforming based on difference equations with graphs.

Array Beamforming with Linear Difference Equations

Yiteng (Arden) Huang

Audio Signal Processing for Next-Generation Multimedia Communication Systems presents cutting-edge digital signal processing theory and implementation techniques for problems including speech acquisition and enhancement using microphone arrays, new adaptive filtering algorithms, multichannel acoustic echo cancellation, sound source tracking and separation, audio coding, and realistic sound stage reproduction. This book's focus is almost exclusively on the processing, transmission, and presentation of audio and acoustic signals in multimedia communications for telecollaboration where immersive acoustics will play a great role in the near future.

Audio Signal Processing for Next-Generation Multimedia Communication Systems

Sharon Gannot

Modern communication devices, such as mobile phones, teleconferencing systems, VoIP, etc., are often used in noisy and reverberant environments. Therefore, signals picked up by the microphones from telecommunication devices contain not only the desired near-end speech signal, but also interferences such as the background noise, far-end echoes produced by the loudspeaker, and reverberations of the desired source. These interferences degrade the fidelity and intelligibility of the near-end speech in human-to-human telecommunications and decrease the performance of human-to-machine interfaces (i.e., automatic speech recognition systems). The proposed book deals with the fundamental challenges of speech processing in modern communication, including speech enhancement, interference suppression, acoustic echo cancellation, relative transfer function identification, source localization, dereverberation, and beamforming in reverberant environments. Enhancement of speech signals is necessary whenever the source signal is corrupted by noise. In highly non-stationary noise environments, noise transients, and interferences may be extremely annoying. Acoustic echo cancellation is used to eliminate the acoustic coupling between the loudspeaker and the microphone of a communication device. Identification of the relative transfer function between sensors in response to a desired speech signal enables to derive a reference noise signal for suppressing directional or coherent noise sources. Source localization, dereverberation, and beamforming in reverberant environments further enable to increase the intelligibility of the near-end speech signal.

Challenges and Perspectives

Speech Processing in Modern Communication

Shoji Makino

A strong reference on the problem of signal and speech enhancement, describing the newest developments in this exciting field. The general emphasis is on noise reduction, because of the large number of applications that can benefit from this technology.

Speech Enhancement

Yiteng Huang

M. M. Sondhi

This handbook plays a fundamental role in sustainable progress in speech research and development. With an accessible format and with accompanying DVD-Rom, it targets three categories of readers: graduate students, professors and active researchers in academia, and engineers in industry who need to understand or implement some specific algorithms for their speech-related products. It is a superb source of application-oriented, authoritative and comprehensive information about these technologies, this work combines the established knowledge derived from research in such fast evolving disciplines as Signal Processing and Communications, Acoustics, Computer Science and Linguistics.

Springer Handbook of Speech Processing

Steven L. Gay

158 2. Wiener Filtering 159 3. Speech Enhancement by Short-Time Spectral Modification 3. 1 Short-Time Fourier Analysis and Synthesis 159 160 3. 2 Short-Time Wiener Filter 161 3. 3 Power Subtraction 3. 4 Magnitude Subtraction 162 3. 5 Parametric Wiener Filtering 163 164 3. 6 Review and Discussion Averaging Techniques for Envelope Estimation 169 4. 169 4. 1 Moving Average 170 4. 2 Single-Pole Recursion 170 4. 3 Two-Sided Single-Pole Recursion 4. 4 Nonlinear Data Processing 171 5. Example Implementation 172 5. 1 Subband Filter Bank Architecture 172 173 5. 2 A-Posteriori-SNR Voice Activity Detector 5. 3 Example 175 6. Conclusion 175 Part IV Microphone Arrays 10 Superdirectional Microphone Arrays 181 Gary W. Elko 1. Introduction 181 2. Differential Microphone Arrays 182 3. Array Directional Gain 192 4. Optimal Arrays for Spherically Isotropic Fields 193 4. 1 Maximum Gain for Omnidirectional Microphones 193 4. 2 Maximum Directivity Index for Differential Microphones 195 4. 3 Maximimum Front-to-Back Ratio 197 4. 4 Minimum Peak Directional Response 200 4. 5 Beamwidth 201 5. Design Examples 201 5. 1 First-Order Designs 202 5. 2 Second-Order Designs 207 5. 3 Third-Order Designs 216 5. 4 Higher-Order designs 221 6. Optimal Arrays for Cylindrically Isotropic Fields 222 6. 1 Maximum Gain for Omnidirectional Microphones 222 6. 2 Optimal Weights for Maximum Directional Gain 224 6. 3 Solution for Optimal Weights for Maximum Front-to-Back Ratio for Cylindrical Noise 225 7. Sensitivity to Microphone Mismatch and Noise 230 8.

Acoustic Signal Processing for Telecommunication

Noise is everywhere and in most applications that are related to audio and speech, such as human-machine interfaces, hands-free communications, voice over IP (VoIP), hearing aids, teleconferencing/telepresence/telecollaboration systems, and so many others, the signal of interest (usually speech) that is picked up by a microphone is generally contaminated by noise. As a result, the microphone signal has to be cleaned up with digital signal processing tools before it is stored, analyzed, transmitted, or played out. This cleaning process is often called noise reduction and this topic has attracted a considerable amount of research and engineering attention for several decades. One of the objectives of this book is to present in a common framework an overview of the state of the art of noise reduction algorithms in the single-channel (one microphone) case. The focus is on the most useful approaches, i.e., filtering techniques (in different domains) and spectral enhancement methods. The other objective of Noise Reduction in Speech Processing is to derive all these well-known techniques in a rigorous way and prove many fundamental and intuitive results often taken for granted. This book is especially written for graduate students and research engineers who work on noise reduction for speech and audio applications and want to understand the subtle mechanisms behind each approach. Many new and interesting concepts are presented in this text that we hope the readers will find useful and inspiring.

Noise Reduction in Speech Processing

Telecommunication systems and human-machine interfaces have begun using multiple microphones and loudspeakers to render interaction more lifelike, and more efficient. This raises acoustic signal processing problems under multiple-input multiple-output (MIMO) scenarios, encompassing distant speech acquisition, sound source localization and tracking, echo and noise control, source separation and speech dereverberation, and many others. The book opens with an acoustic MIMO paradigm, establishing fundamentals, and linking acoustic MIMO signal processing with classical signal processing and communication theories. The second part of the book presents a novel analysis of acoustic applications carried out in the paradigm to reinforce the fundamentals of acoustic MIMO signal processing.

Acoustic MIMO Signal Processing

For the first time, a reference on the most relevant applications of adaptive filtering techniques. Top researchers in the field contributed chapters addressing applications in acoustics, speech, wireless and networking, where research is still very active and open.

Applications to Real-World Problems

Adaptive Signal Processing

Though noise reduction and speech enhancement problems have been studied for at least five decades, advances in our understanding and the development of reliable algorithms are more important than ever, as they support the design of tailored solutions for clearly defined applications. In this work, the authors propose a conceptual framework that can be applied to the many different aspects of noise reduction, offering a uniform approach to monaural and binaural noise reduction problems, in the time domain and in the frequency domain, and involving a single or multiple microphones. Moreover, the derivation of optimal filters is simplified, as are the performance measures used for their evaluation.

A Conceptual Framework for Noise Reduction

Mads Graesboll Christensen

Jesper Rindom Jensen

Speech enhancement is a classical problem in signal processing, yet still largely unsolved. Two of the conventional approaches for solving this problem are linear filtering, like the classical Wiener filter, and subspace methods. These approaches have traditionally been treated as different classes of methods and have been introduced in somewhat different contexts. Linear filtering methods originate in stochastic processes, while subspace methods have largely been based on developments in numerical linear algebra and matrix approximation theory. This book bridges the gap between these two classes of methods by showing how the ideas behind subspace methods can be incorporated into traditional linear filtering. In the context of subspace methods, the enhancement problem can then be seen as a classical linear filter design problem. This means that various solutions can more easily be compared and their performance bounded and assessed in terms of noise reduction and speech distortion. The book shows how various filter designs can be obtained in this framework, including the maximum SNR, Wiener, LCMV, and MVDR filters, and how these can be applied in various contexts, like in single-channel and multichannel speech enhancement, and in both the time and frequency domains. First short book treating subspace approaches in a unified way for time and frequency domains, single-channel, multichannel, as well as binaural, speech enhancement Bridges the gap between optimal filtering methods and subspace approaches Includes original presentation of subspace methods from different perspectives

Jacob Benesty

Books

Your next favorite book is out there