Personalized Acoustic Echo Cancellation for Full-duplex Communications

Shimin Zhang1, Ziteng Wang, Yukai Ju1, Yihui Fu1, Yueyue Na, Qiang Fu, Lei Xie1
1Audio, Speech and Language Processing Group (ASLP@NPU), Northwestern Polytechnical University, Xi'an, China

0. Contents

  1. Abstract
  2. Corresponding input and label
  3. DT-Noise (SER=5 dB, SIR=5 dB)
  4. DT-Noise (SER=5 dB, SIR=15 dB)
  5. DT-Noise (SER=15 dB, SIR=5 dB)
  6. DT-Noise (SER=15 dB, SIR=15 dB)


1. Abstract

Deep neural networks (DNNs) have shown promising results for acoustic echo cancellation (AEC). But the DNN-based AEC models let through all near-end speakers including the interfering speech. In light of recent studies on personalized speech enhancement, we investigate the feasibility of personalized acoustic echo cancellation (PAEC) in this paper for full-duplex communications, where background noise and interfering speakers may coexist with acoustic echoes. Specifically, we first propose a novel backbone neural network termed as gated temporal convolutional neural network (GTCNN) that outperforms state-of-the-art AEC models in performance. Speaker embeddings like d-vectors are further adopted as auxiliary information to guide the GTCNN to focus on the target speaker. A special case in PAEC is that speech snippets of both parties on the call are enrolled. Experimental results show that auxiliary information from either the near-end speaker or the far-end speaker can improve the DNN-based AEC performance. Nevertheless, there is still much room for improvement in the utilization of the finite-dimensional speaker embeddings.



2. The corresponding reference, enrolled speech and label

- Sample 1 Sample 2 Sample 3 Sample 4
Label
Reference
Near-end enrolled
Far-end enrolled


3. SER=5 dB, SIR=5 dB, trained with D3

Models Sample 1 Sample 2 Sample 3 Sample 4
Microphone
GCCRN
DTLN
GTCNN-E_s
GTCNN-E_x
GTCNN-E_mix
GTCNN-L


4. SER=5 dB, SIR=15 dB, trained with D3

Models Sample 1 Sample 2 Sample 3 Sample 4
Microphone
GCCRN
DTLN
GTCNN-E_s
GTCNN-E_x
GTCNN-E_mix
GTCNN-L


5. SER=15 dB, SIR=5 dB, trained with D3

Models Sample 1 Sample 2 Sample 3 Sample 4
Microphone
GCCRN
DTLN
GTCNN-E_s
GTCNN-E_x
GTCNN-E_mix
GTCNN-L

6. SER=15 dB, SIR=15 dB, trained with D3

Models Sample 1 Sample 2 Sample 3 Sample 4
Microphone
GCCRN
DTLN
GTCNN-E_s
GTCNN-E_x
GTCNN-E_mix
GTCNN-L