基于语音能量比的解决频域ICA次序不确定性问题的算法

doi:10.12066/j.issn.1007-2861.2239

Abstract

Abstract:

With the development of artificial intelligence & internet of things (AIoT) and the rapid advancement of hardware technology, an increasing number of smart speakers are becoming a part of people's lives. Human-computer interaction has also witnessed a shift from remote control to voice control. However, the audio signals recorded by the microphone in a device usually contain considerable noise and interfering voices. Therefore, separation needs to be performed on the signals recorded by the microphones. Frequency-domain independent component analysis (ICA) is a commonly used separation technique, but it faces the permutation indeterminacy problem, i.e., the separated components from Source 1 are classified into a channel for Source 2, whereas the separated components from Source 2 are classified into a channel for Source 1, which greatly deteriorates the separation performance. To address this issue, we proposed an algorithm based on the speech energy ratio, which effectively improved the separation performance. The separation performance was tested on the Signal Separation Evaluation Campaign (SiSEC) and Computational Hearing in Multisource Environments (CHiME) datasets. The results showed that the proposed algorithm outperformed existing algorithms, and a good separation performance for mixed signals could be maintained even in an environment with strong reverberations.

Key words: blind source separation, speech separation, frequency-domain independent component analysis, permutation indeterminacy, energy ratio

CLC Number:

TN912.3

ANG Zhiqiang, WANG Tao, JIN Zhiwen. An algorithm for solving the permutation indeterminacy problem of frequency-domain ICA based on speech energy ratio[J]. Journal of Shanghai University（Natural Science Edition）, 2022, 28(2): 226-237.

Figures/Tables 10

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Table 1

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

References 20

[1]	Jutten C, Herault J. Blind separation of sources, Part 1: an adaptive algorithm based on neuromimetic architecture[J]. Signal Processing, 1991, 24(1): 1-10. doi: 10.1016/0165-1684(91)90079-X
[2]	Comon P. Independent component analysis, a new concept?[J]. Signal Processing, 1994, 36(3): 287-314. doi: 10.1016/0165-1684(94)90029-9
[3]	吴奇昌, 马峰, 戴礼荣. 一种新的基于频域独立成分分析的语音信号盲分离方法[J]. 电路与系统学报, 2013, 18(2): 405-412.
[4]	Nesta F, Svaizer P, Omologo M. Convolutive BSS of short mixtures by ICA recursively regularized across frequencies[J]. IEEE Transactions on Audio Speech and Language Processing, 2010, 19(3): 624-639. doi: 10.1109/TASL.2010.2053027
[5]	Nesta F, Matassoni M. Blind source extraction for robust speech recognition in multisource noisy environments[J]. Computer Speech and Language, 2013, 27(3): 703-725. doi: 10.1016/j.csl.2012.08.001
[6]	Nesta F, Omologo M. Convolutive underdetermined source separation through weighted interleaved ICA and spatio-temporal source correlation[M]// Vigneron V, Zarzoso V, Gribonval R, et al. Latent variable analysis and signal separation. Berlin: Springer-Verlag, 2012: 222-230.
[7]	Sawada H, Mukai R, Araki S, et al. A robust and precise method for solving the permutation problem of frequency-domain blind source separation[J]. IEEE Transactions on Speech and Audio Processing, 2004, 12(5): 530-538. doi: 10.1109/TSA.2004.832994
[8]	Chen Z T, Chan L W. New approaches for solving permutation indeterminacy and scaling ambiguity in frequency domain separation of convolved mixtures[C]// 2011 International Joint Conference on Neural Networks. 2011: 911-918.
[9]	Kitamura D, Ono N, Sawada H, et al. Determined blind source separation unifying independent vector analysis and nonnegative matrix factorization[J]. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2016, 24(9): 1626-1641. doi: 10.1109/TASLP.2016.2577880
[10]	Sawada H, Mukai R, Araki S, et al. Polar coordinate based nonlinear function for frequency-domain blind source separation[C]// IEEE International Conference on Acoustics, Speech, and Signal Processing. 2003: I-1001-I-1004.
[11]	Mallis D, Sgouros T, Mitianoudis N. Convolutive audio source separation using robust ICA and an intelligent evolving permutation ambiguity solution[J]. Evolving Systems, 2018, 9(4): 315-329. doi: 10.1007/s12530-017-9199-3
[12]	Naik G R, Kumar D K. An overview of independent component analysis and its applications[J]. Informatica, 2011, 35(1): 63-81.
[13]	Amari S I. Natural gradient works efficiently in learning[J]. Neural Computation, 1998, 10(2): 251-276. doi: 10.1162/089976698300017746
[14]	Romano J M T, Attux R, Cavalcante C C, et al. Unsupervised signal processing: channel equalization and source separation[M]. Boca Raton: CRC Press, 2018.
[15]	Ding S, Cichocki A, Huang J, et al. Blind source separation of acoustic signals in realistic environments based on ICA in the time-frequency domain[J]. International Journal of Pervasive Computing and Communications, 2005, 1(2): 89-100. doi: 10.1108/17427370580000115
[16]	Saruwatari H, Kurita S, Takeda K, et al. Blind source separation combining independent component analysis and beamforming[J]. EURASIP Journal on Advances in Signal Processing, 2003, 2003(11): 1-12.
[17]	Ozerov A, Vincent E, Bimbot F. A general flexible framework for the handling of prior information in audio source separation[J]. IEEE Transactions on Audio, Speech and Language Processing, 2012, 20(4): 1118-1133. doi: 10.1109/TASL.2011.2172425
[18]	Vincent E, Gribonval R, Fevotte C. Performance measurement in blind audio source separation[J]. IEEE Transactions on Audio, Speech and Language Processing, 2006, 14(4): 1462-1469. doi: 10.1109/TSA.2005.858005
[19]	Rix A W, Beerends J G, Hollier M P, et al. Perceptual evaluation of speech quality (PESQ): a new method for speech quality assessment of telephone networks and codecs[C]// IEEE International Conference on Acoustics, Speech, and Signal Processing. 2001: 749-752.
[20]	Vincent E, Virtanen T, Gannot S. Audio source separation and speech enhancement[M]. Hoboken: John Wiley & Sons, 2018.

An algorithm for solving the permutation indeterminacy problem of frequency-domain ICA based on speech energy ratio

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 10

References 20

Related Articles 2

Recommended Articles

Metrics

Comments

[1]	ZHANG Yejun, YANG Weiying. Reduction of background audio noise for historical films based on non-negative matrix factorization [J]. Journal of Shanghai University（Natural Science Edition）, 2017, 23(3): 333-341.
[2]	WANG Jun-hua,FANG Yong. Blind Separation of Noisy Image Based on Adaptive Morphological De-noising in Curvelet Transform Domain [J]. Journal of Shanghai University（Natural Science Edition）, 2010, 16(4): 336-341.