Decoupled Spatial and Temporal Processing for Resource Efficient Multichannel Speech Enhancement
Nikitha Y
Elecronics and Communication Engg (of Aff.) Institute of Aeronautical Engg(of Aff.)
Dunigal, India nikithayedugani@gmail.com
Chaitanya D
Pujita K
Elecronics and Communication Engg (of Aff.) Institute of Aeronautical Engineering (of Aff.)
Dundigal, India pujitakrishnan@gmail.com
Dr. S CHINA VENKATESWARLU
Elecronics and Communication Engg (of Aff.) Institute of Aeronautical Engineering (of Aff.)
Dundigal, India chaitanyareddy@gmail.com
Electronics and Communication Engineering (of Aff.) Institut of Aeronautical Engineering (of Aff.)
Dundigal,India nikithayedugani@gmail.com
Abstract—Speech enhancement is essential in various modern applications, including telecommunications, hearing aids, and voice-controlled systems. The presence of background noise and reverberation can significantly degrade speech quality, making it challenging to understand. Traditional single-channel speech enhancement techniques often struggle in complex acoustic envi- ronments. In contrast, multichannel speech enhancement, which utilizes multiple microphones, offers improved performance by leveraging spatial information to better separate speech from noise. An original model intended for asset effective multichannel discourse upgrade the time space, with an emphasis on low inert- ness, lightweight, and low computational necessities The support- ive of presented model consolidates express spatial and transient handling in inside profound brain organization (DNN) layers. Motivated by recurrence subordinate of multichannel separating, our spatial sifting process applies different teachable channels to each secret unit across the spatial dimensions, coming about in a multichannel yield. The fleeting handling is applied over a solitary channel yield stream from the spatial favorable to accessing utilizing a Long Transient Memory (LSTM) organization. Model fundamentally beats powerful gauge models while requesting far less boundaries and for calculations, while accomplishing a super low algorithmic idleness of only 2 milliseconds. By leveraging the spatial diversity of multichannel recordings and combining it with advanced temporal algorithms, the proposed system achieves superior noise reduction and speech enhancement. This approach has the potential to improve the performance of various applications, including telecommunications, hearing aids, and voice-controlled systems, providing clearer and more intelligible speech in challenging acoustic environments.
Index Terms—Multichannel Speech Enhancement, Deep Neu- ral Networks (DNN), Signal-to-Noise Ratio (SNR), Spatial Pro- cessing, Temporal Processing, Low Latency.
