1.2

chapter_01.tex

@@ -21,18 +21,9 @@ Usually, a CI system consists out of an external processor with a microphone (``
     \label{fig:fig_electrode}
 \end{figure}
 \noindent As for any head worn hearing aid, the audio processor of a CI system does not only pick up the desired ambient audio signal, but also any sort of interference noises from different sources. This circumstance leads to a decrease in the quality of the final audio signal for the user. Reducing this interference noise through adaptive noise reduction, implemented on a low-power digital signal processor, which can be powered within the electrical limitations of a CI system, is the topic of this master's thesis.
-\subsection{The problem of signal interference in audio processing}
-A signal is a physical parameter (e.g. pressure, voltage) changing its value over time. The term "signal interference" describes the overlapping of two or more signals resulting in a new signal. \\ \\A simple example of a desirable signal interference would be the sound generated by playing several strings of a guitar. Hitting one string results in a pure sine wave of a designated frequency (depending on which note is played), perceptible as sound. Hitting a chord (consisting of several strings), the separate sine waves of the strings combine to a new signal through the process of signal interference - in this case a desired, harmonic sound. (see Figure \ref{fig:fig_interference})
-\begin{figure}[H]
-    \centering
-    \includegraphics[width=0.8\linewidth]{Bilder/fig_interference.png}
-    \caption{Signal interference of three separate tones resulting in an E-Minor chord.}
-    \label{fig:fig_interference}
-\end{figure}
-\noindent In technical environments signal interference is also common when electromagnetic and acoustic noise coexist. Such conditions can cause electromagnetic coupling or broadband acoustic noise that degrades microphone input and digital transmission. Therefore, in auditory applications, signal interference can cause a considerable degradation to the quality of the final signal, posing an additional challenge to aurally impaired people using an implant solution for rehabilitation. Thus, the objective of this thesis shall be the improvement of implant technology in regard of adaptive noise reduction.
 \subsection{Implementation of Adaptive Noise Reduction in Cochlear Implant Systems}
-The above problem statement of signal interference shows its significance in the improvement of CI systems. For persons with a healthy hearing sense, the addition of noise to an observed signal may just mean a decrease in hearing comfort, whereas for aurally impaired people it can make the difference in the basic understanding of information. As everyday environments present fluctuating background noise - from static crowd chatter to sudden sounds of different characteristics — that can severely degrade speech perception, the ability to suppress noise is a crucial benefit for users of cochlear implant systems. \\ \\
-Adaptive noise reduction (ANR) (also commonly referred as adaptive noise cancellation (ANC)), is an advanced signal-processing technique that adjusts the parameters of a digital filter to suppress unwanted noise from a signal while preserving the desired target signal. In contrary to static filters (like a high- or low-pass filter), ANR uses real-time feedback to adjust said digital filter to adapt to the current circumstances.\\ \\
+The above problem description of noise interference shows the need of further improvement of CI systems in this regard. For persons with a healthy hearing sense, the addition of noise to an observed signal may just mean a decrease in hearing comfort, whereas for aurally impaired people it can make the difference in the basic understanding of information. As everyday environments present fluctuating background noise - from static crowd chatter to sudden sounds of different characteristics — that can severely degrade speech perception, the ability to suppress noise is a crucial benefit for users of cochlear implant systems. \\ \\
+Adaptive noise reduction (ANR) (also commonly referred as adaptive noise cancellation (ANC)), is an advanced signal processing technique that adjusts the parameters of a digital filter to suppress unwanted noise from a signal while preserving the desired target signal. In contrary to static filters (like a high- or low-pass filter), ANR uses real-time feedback to adjust said digital filter to adapt to the current circumstances.\\ \\
 The challenge in the implementation of ANR in CI systems lies in the limited capacities. As the CI system is powered by a small battery located in the audio processor, energy efficiency is crucial for a possible solution of the described problem of noise interference. Any approach to a reduction of interference noise must be highly optimized with regard to computing power and implemented on dedicated low-power hardware, being able to be powered within the limitations of a CI system.\\ \\
 The main solution concept of this thesis is the optimization of the adaptive filter of the ANR algorithm in combination with the used low-power hardware. Its goal is, to deliver the best possible result in interference noise reduction while still being able to be powered by the limited resources of a CI system. Different variants, like the fully adaptive filter, the hybrid static/adaptive filter and different optimization approaches of the latter one are low-level simulated on the dedicated digital signal processor. Especially, the different optimization strategies of the hybrid static/adaptive filter algorithm shall be evaluated and compared in regard of their required computing power, and therefore, their required power consumption. Depending on the kind of interference noise, the frequency and the intensity, a promising optimization approach is the reduction of adaptation steps per sample while still maintaining an adequate quality of the filtered audio signal.\\ \\
 Due to the fact, that the CI system is powered by a battery with a relatively small capacity, the firmware is required to work with the least power possible. Therefore, optimization in regard to a minimization of needed processor clocks is aimed for.

chapter_02.tex

@@ -1,20 +1,36 @@
 \section{Theoretical Background}
 The following subchapters shall supply the reader with the theoretical foundation of digital signal processing to better understand the following implementation of ANR on a low-power signal processor.\\ \\
-The chapter begins with the basics of digital signal processing in general, covering fundamental topics like signals, transfer functions and filters.\\
+The chapter begins with the decription of signals, the problem of them interfering and the basics of digital signal processing in general, covering fundamental topics like signal representation, transfer functions and filters.\\
 Filters are used in various functional designs, therefore a short explanation into the concepts of Finite Impulse Response- and Infinite Impulse Response filters is indispensable.\\
-At this point an introduction into adaptive noise reduction follows, including a short overview of the most important steps in history, the general concept of ANR, its design possibilities and its use of the Least-Mean-Square algorithm.\\
+At this point an introduction into adaptive noise reduction follows, including a short overview of the most important steps in history, the general concept of ANR, its design possibilities and its optimization possibilities in regard of error calculation.\\
 With this knowledge covered, a realistic signal flow diagram of an implanted CI system with corresponding transfer functions is designed, essential to implement ANR on a low-power digital signal processor.\\
-At the end of chapter two, high-level Python simulations shall function as a practical demonstration of the recently presented theoretical background.\\ \\
+At the end of chapter two, high-level Python simulations shall function as a practical demonstration of the recently presented theoretical background.
+\subsection{Signals and signal interference}
+A signal is a physical parameter (e.g. pressure, voltage) changing its value over time. Whereas in nature, a signal is always analog, meaning continuous in both time and amplitude, a digital signal is represented in a discrete form, being sampled at specific time intervals and quantized to finite amplitude levels.\\ \\
+The term "signal interference" describes the overlapping of unwanted signals or noise with the desired signal, degrading the overall quality and intelligibility of the processed information. A simple example of signal interference is shown in Figure \ref{fig:fig_interference} - the noisy signal (top) consists out of several signals of different frequencies, representing both the desired signal and unwanted noise. The cleaned signal (bottom) shows the desired signal after unwanted frequencies has been cut off by a filter.\\ \\
+\begin{figure}[H]
+    \centering
+    \includegraphics[width=0.8\linewidth]{Bilder/fig_interference.jpg}
+    \caption{Noisy signal containing different frequencyies and cleaned signal. \cite{source_dsp_ch1}}
+    \label{fig:fig_interference}
+\end{figure}
+\noindent In cochlear implant systems, speech signals must be reconstructed with high spectral precision to ensure intelligibility for the user. As signal interference can cause considerable degradation to the quality of said final audio signal, the objective of this thesis shall be the improvement of implant technology in regard of adaptive noise reduction.
 \subsection{Fundamentals of digital signal processing}
 Digital signal processing describes the manipulation of digital signals on a digital signal processor (DSP) trough mathematical approaches. Analog signals have to be digitalized before being able to be handled by a DSP. 
-\subsubsection{Signals}
+\subsubsection{Signal conversion and representation}
 \begin{figure}[H]
     \centering
     \includegraphics[width=0.8\linewidth]{Bilder/fig_dsp.jpg}
-    \caption{Block diagram of processing an analog input signal to an analog output signal with digital signal processing in between  \cite{source_dsp_ch1}}
+    \caption{Block diagram of processing an analog input signal to an analog output signal with digital signal processing in between. \cite{source_dsp_ch1}}
     \label{fig:fig_dsp}
 \end{figure}
-Before digital signal processing can be applied to an analog signal like human voice, several steps are required beforehand. An analog signal, continuous in both time and amplitude, is passed through an initial filter, which limits the frequency bandwidth. An analog-digital converter then samples and quantities the signal into a digital form, now discrete in time and amplitude. This digital signal can now be processed, before (possibly) being converted to an analog signal again (refer to Figure \ref{fig:fig_dsp}). The sampling rate defines, in how many samples per second are taken from the analog signal - a higher sample rate delivers a more accurate digital representation of the signal but also uses more resources. According to the Nyquist–Shannon sampling theorem, the sample rate must be at least twice the highest frequency component present in the signal to avoid aliasing of the signal. Aliasing describes the phenomenon, that high frequency parts of a signal are wrongly interpreted, if the sampling rate of the analog signal is too low. The digitlazied signal then contains low frequencies, which don´t occur in the original signal. \\ \\
+Before digital signal processing can be applied to an analog signal like human voice, several steps are required beforehand. An analog signal, continuous in both time and amplitude, is passed through an initial filter, which limits the frequency bandwidth. An analog-digital converter then samples and quantities the signal into a digital form, now discrete in time and amplitude. This digital signal can now be processed, before (possibly) being converted to an analog signal again (refer to Figure \ref{fig:fig_dsp}). The sampling rate defines, in how many samples per second are taken from the analog signal - a higher sample rate delivers a more accurate digital representation of the signal but also uses more resources. According to the Nyquist–Shannon sampling theorem, the sample rate must be at least twice the highest frequency component present in the signal to avoid aliasing of the signal (refer to Figure \ref{fig:fig_nyquist}). Aliasing describes the phenomenon, that high frequency parts of a signal are wrongly interpreted, if the sampling rate of the analog signal is too low. The digitlazied signal then contains low frequencies, which don´t occur in the original signal.
+\begin{figure}[H]
+    \centering
+    \includegraphics[width=0.8\linewidth]{Bilder/fig_nyquist.jpg}
+    \caption{Adequate (top) and inadequate (bottom) sampling frequency of a signal. \cite{source_dsp_ch1}}
+    \label{fig:fig_nyquist}
+\end{figure}
 Throughout this thesis, sampled signals are denoted in lowercase with square brackets (e.g. {x[n]}) to distinguish them from time-continuous signals 
 (e.g. {x(t)}).\\ 
 The discrete digital signal can be viewed as a sequence of finite samples with its amplitude being a discrete value, like a 16- or 32-bit integer. A signal vector of the length N, containing N samples, is therefore notated as
@@ -40,7 +56,7 @@ When we discuss signals in a mathematical way, we need to explain the term ``tra
     \label{fig:fig_transfer}
 \end{figure}
 \noindent In digital signal processing, especially in the design of a noise reduction algorithm, transfer functions are essential for modeling and analyzing filters, amplifiers, and the pathway of the signal itself. By understanding a system’s transfer function, one can predict how sound signals are altered and therefore how filter parameters can be adapted to deliver the desired output signal.\\ \\
-During the description of transfer functions, the term ``filter'' was used but not yet defined. A filter can be understood as a component in signal processing, designed to modify or extract specific parts of a signal by selectively allowing certain frequency ranges to pass while attenuating others. Filters can be static, meaning they always extract the same portion of a signal, or adaptive, meaning they change their filtering behavior over time according to their environment. Examples for static filter include low-pass-, high-pass-, band-pass- and band-stop filters, each tailored to isolate or remove particular frequency content (refer to Figure \ref{fig:fig_lowpass}).
+During the description of transfer functions, the term ``filter'' was used but not yet defined. A filter can be understood as a component in signal processing, designed to modify or extract specific parts of a signal by selectively allowing certain frequency ranges to pass while attenuating others. Filters can be static, meaning they always extract the same portion of a signal, or adaptive, meaning they change their filtering behavior over time according to their environment. Examples of static filter include low-pass-, high-pass-, band-pass- and band-stop filters, each tailored to isolate or remove particular frequency content (refer to Figure \ref{fig:fig_lowpass}).
 \begin{figure}[H]
     \centering
     \includegraphics[width=0.8\linewidth]{Bilder/fig_lowpass.jpg}
@@ -56,7 +72,8 @@ Equation \ref{equation_fir} specifies the input-output relationship of a FIR fil
 \label{equation_fir}
  y[n] = \sum_{k=0}^{M} b_kx[n-k] = b_0x[n] + b_1x[n-1] + ... + b_Mx[n-M]
 \end{equation}
-Figure \ref{fig:fig_fir} visualizes a simple FIR filter with two coefficients - the first sample is multiplied with the operator $b_0$ whereas the following sample $b1$ is multiplied with the operator $b_1$ before added back together. The Operator $Z^{-1}$ represents a delay operator of one sample.
+Figure \ref{fig:fig_fir} visualizes a simple FIR filter with three coefficients - the first sample is multiplied with the operator $b_0$ whereas the following samples are multiplied with the operators $b_1$ amd $b_2$ before added back together. The Operator $Z^{-1}$ represents a delay operator of one sample.
+As there are three operators present in the filter, three samples are needed before the filter response is complete.
 \begin{figure}[H]
     \centering
     \includegraphics[width=0.8\linewidth]{Bilder/fig_fir.jpg}
@@ -70,7 +87,7 @@ Equation \ref{equation_iir} specifies the input-output relationship of a IIR fil
 \label{equation_iir}
  y[n] = \sum_{k=0}^{M} b_kx[n-k] - \sum_{k=0}^{N} a_ky[n-k] = b_0x[n] + ... + b_Mx[n-M] - a_0y[n] - ... - a_Ny[n-N]
 \end{equation}
-Figure \ref{fig:fig_iir} visualizes a simple IIR filter with one feedforward coefficient and one feedback coefficient. The first sample passes through the adder after it was multiplied with $b_0$. After that, it is passed back after being multiplied with $a_0$ and is added two the second sample, also multiplied with $b_0$.
+Figure \ref{fig:fig_iir} visualizes a simple IIR filter with two feedforward coefficients and two feedback coefficient. The first sample passes through the adder after it was multiplied with $b_0$. After that, it is passed back after being multiplied with $a_0$. The second sample is then processed the same way - this time multiplied with $b_1$ and $b_1$. After two samples, the response of this exemplary IIR filter is complete.
 \begin{figure}[H]
     \centering
     \includegraphics[width=0.8\linewidth]{Bilder/fig_iir.jpg}
@@ -81,7 +98,8 @@ Figure \ref{fig:fig_iir} visualizes a simple IIR filter with one feedforward coe
 Due to the fact, that there is no feedback, a FIR filter offers unconditional stability, meaning that the filter response always converges, no matter how the coefficients are set. The disadvantages of the FIR design is the relatively flat frequency response and the higher number of needed coefficitents needed to achieve a certain frequency response compared to its Infinite Impulse Response counterpart.\\ \\
 The recursive nature of an IIR filter, in contrary, allows to achieve a sharp frequency response with significantly fewer coefficients than an equivalent FIR filter, but it also opens up the possibility, that the filter response diverges, depending on the set coefficients.\\ \\
 A higher number of needed coefficients implies, that the filter itself needs more time to complete it´s signal response, as more samples are needed to pass the filter.
-\subsection{Introduction to Adaptive Nose Reduction}
+
+\subsection{Introduction to Adaptive Noise Reduction}
 \subsubsection{History}
 The necessity for the use of electric filters arose the first time in the beginnings of the 20th century with the development of the quite young fields of tele- and radio-communication. At his time, engineers used static filters like low- or highpass filters to improve transmission quality - this fundamental techniques allowed limiting the frequency spectrum, by cutting out certain frequencies like high-pitched noises or humming. From this time on, the development of new filter designs accelerated, for example with the soon-to-be developed LC-filter by Otto Zobel, an American scientist working at the telecommunication company AT\&T. Until then, the used filters were static, meaning they didn't change their behavior over time.\\ \\
 In the 1930s, the first real concept of active noise cancellation was proposed by the German Physician Paul Lueg. Lueg patented the idea of two speakers emitting antiphase signals which cancel each other out. Though his patent was granted in 1936, back at the time, there was no technical possibility detect and process audio signals in a way, to make his noise cancellation actually work in a technical environment.\\ \\
@@ -93,7 +111,7 @@ In the 1930s, the first real concept of active noise cancellation was proposed b
     \label{fig:fig_patent}
 \end{figure}
 \noindent In contrary to the static filters in the beginning of the century, the active noise cancellation of Lueg and Widrow was far more advanced than just reducing a signal by a specific frequency portion like with the use of static filters, yet this technique still has their limitations as it is designed only to work within to a certain environment.\\ \\
-With the rapid advancement of digital signal processing technologies, noise cancellation techniques  evolved from static, hardware-based filters and pyhsical soundwave cancellation towards more sophisticated approaches. In the then 1970s, the concept of digital adaptive filtering was introduced, allowing filters to adjust their parameters in real-time based on the characteristics of the incoming signal and noise. This marked a significant leap forward, as it enabled systems to cope with dynamic and unpredictable noise environments - the concept of adaptive noise reduction was born.\\ \\
+With the rapid advancement of digital signal processing technologies, noise cancellation techniques  evolved from static, hardware-based filters and pyhsical soundwave cancellation towards more sophisticated approaches. In the then 1970s, the concept of digital adaptive filtering arose, allowing digital filters to adjust their parameters in real-time based on the characteristics of the incoming signal and noise. This marked a significant leap forward, as it enabled systems to deal with dynamic and unpredictable noise environments - the concept of adaptive noise reduction was born.
 \subsubsection{The concept of adaptive filtering}
 Adaptive noise reduction describes an advanced filtering method based on an error-metric and represents a significant advancement over these earlier methods by allowing the filter parameters to continuously adapt to the changing acoustic environment in real-time. This adaptability makes ANR particularly suitable for hearing devices, where environmental noise characteristics vary constantly.\\ \\
 Static filters low- and high-pass filters as described in the previous chapter feature coefficients that remain constant over time. They are designed for known, predictable noise conditions (e.g., removing a steady 50 Hz hum). While these filters are efficient and easy to implement, they fail to function when noise characteristics change dynamically.\\ \\
@@ -104,12 +122,13 @@ Although active noise cancellation and adaptive noise reduction share obvious si
     \caption{The basic idea of an adaptive filter design for noise reduction.}
     \label{fig:fig_anr}
 \end{figure}
-Figure \ref{fig:fig_anr} shows the basic concept of an adaptive filter design, represented through a feedback filter application. The signal sensor aims to recieve the input signal, which consists out of the target signal and the noise signal, whereas the noise sensor aims to recieve (ideally) only the noise signal, which then feeds the adaptive filter. The adaptive filter removes a certain, noise-related, frequency part of the input signal and re-evaluates the output through its feedback design. The filter parameters are then adjusted and applied to the next sample to minimize the observed error. In reality, a signal contamination of the two sensors has to be expected, which will be illustrated in a more realistic signal flow diagram of an implanted CI system.
-\subsubsection{Static vs. hybrid filter design}
+\noindent Figure \ref{fig:fig_anr} shows the basic concept of an adaptive filter design, represented through a feedback filter application. The signal sensor aims to recieve the input signal $s[n]$, which consists out of the target signal and the noise signal, whereas the noise sensor aims to recieve (ideally) only the noise signa $d[n]$, which then feeds the adaptive filter. The adaptive filter removes a certain, noise-related, frequency part of the input signal and re-evaluates the output through its feedback design. The filter parameters are then adjusted and applied to the next sample to minimize the observed error $e[n]$. In reality, a signal contamination of the two sensors has to be expected, which will be illustrated in a more realistic signal flow diagram of an implanted CI system.
+\subsubsection{Fully adaptive vs. hybrid filter design}
+The basic ANR concept illustrated in Figure \ref{fig:fig_anr} can be understood as a fully adaptive variant. A fully adaptive filter design works with a fixed number of coefficients of which everyone is updated after every sample processing. Even if this approach features the best performance in noise reduction, it also requires a relatively high amount of computing power, as every coefficient has to be updated after every sample.\\ \\
+To reduce the required computing power, a hybrid static/adaptive filter design can be taken into consideration instead. In this approach, a part of the inital fully adaptive filter is split into a fixed and an adaptive part - the static filter removes a certain, known, or estimated, frequency portion of the noise signal, whereas the adaptive part only has to adapt to the remaining, unforecastable, noise parts. This approach reduces the number of required adaptation steps of the adaptive filter, therefore lowering the required computing power. Different approaches of the hybrid static/adaptive filter design will be evaluated and compared in regard of their required computing power in a later chapter of this thesis.
 \subsubsection{Filter optimization}
+In the decription of the concept of adaptive filtering above, the adaption of filter coefficients due to an error metric was mentioned but not further explained.
 
-
-\subsection{Signal flow diagram showing the origin of the useful signal,
-noise signal, and their coupling}
+\subsection{Signal flow diagram of an implanted cochlear implant system}
 \subsection{Derivation of the system’s transfer function based on the problem setup}
 \subsection{Example applications and high-level simulations using Python}