基于语音能量比的解决频域ICA次序不确定性问题的算法

doi:10.12066/j.issn.1007-2861.2239

上海大学学报(自然科学版) ›› 2022, Vol. 28 ›› Issue (2): 226-237.doi: 10.12066/j.issn.1007-2861.2239

基于语音能量比的解决频域ICA次序不确定性问题的算法

王志强¹, 王涛¹(), 金志文²

1.上海大学通信与信息工程学院, 上海 200444
2.中国人民解放军 93216 部队, 北京 100085

收稿日期:2020-04-02 出版日期:2022-04-30 发布日期:2022-04-28
通讯作者: 王涛 E-mail:twang@shu.edu.cn
作者简介:王涛(1980--), 男, 教授, 博士生导师, 博士,研究方向为高能效无线通信、信号处理系统的优化设计等. E-mail: twang@shu.edu.cn
基金资助:
国家自然科学基金资助项目(61671011)

An algorithm for solving the permutation indeterminacy problem of frequency-domain ICA based on speech energy ratio

ANG Zhiqiang¹, WANG Tao¹(), JIN Zhiwen²

1. School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China
2. Unit 96216 of PLA, Beijing 100085, China

Received:2020-04-02 Online:2022-04-30 Published:2022-04-28
Contact: WANG Tao E-mail:twang@shu.edu.cn

摘要/Abstract

摘要：

随着人工智能物联网(artificial intelligence & internet of things, AIoT)的发展, 硬件技术的飞速进步, 更多的智能音箱进入人们的生活, 人机交互方式也从早期的遥控变成了人声控制. 但设备中麦克风采集到的语音信号往往含有大量噪声和干扰人声, 为此需对麦克风采集到的语音进行语音分离处理. 常用的技术有频域独立成分分析(independent component analysis, ICA), 但是频域ICA存在次序不确定性问题, 即将分离出的源1分量分类到源2通道, 将分离出的源2分量分类到源1通道, 从而导致分离性能大大降低. 为此, 提出一种基于语音能量比来解决频域ICA中次序不确定性问题的算法, 有效地提高了分离性能. 在SiSEC(Signal Separation Evaluation Campaign)、ChiME(Challenge for Computational Hearing in Multisoure Environments)数据集上对分离性能进行实验, 所得结果比已有算法均有提升, 且针对强混响环境下的混合信号依然保持良好的分离性能.

关键词: 盲源分离, 语音分离, 频域独立成分分析, 次序不确定性, 能量比

Abstract:

With the development of artificial intelligence & internet of things (AIoT) and the rapid advancement of hardware technology, an increasing number of smart speakers are becoming a part of people's lives. Human-computer interaction has also witnessed a shift from remote control to voice control. However, the audio signals recorded by the microphone in a device usually contain considerable noise and interfering voices. Therefore, separation needs to be performed on the signals recorded by the microphones. Frequency-domain independent component analysis (ICA) is a commonly used separation technique, but it faces the permutation indeterminacy problem, i.e., the separated components from Source 1 are classified into a channel for Source 2, whereas the separated components from Source 2 are classified into a channel for Source 1, which greatly deteriorates the separation performance. To address this issue, we proposed an algorithm based on the speech energy ratio, which effectively improved the separation performance. The separation performance was tested on the Signal Separation Evaluation Campaign (SiSEC) and Computational Hearing in Multisource Environments (CHiME) datasets. The results showed that the proposed algorithm outperformed existing algorithms, and a good separation performance for mixed signals could be maintained even in an environment with strong reverberations.

Key words: blind source separation, speech separation, frequency-domain independent component analysis, permutation indeterminacy, energy ratio

中图分类号:

TN912.3

王志强, 王涛, 金志文. 基于语音能量比的解决频域ICA次序不确定性问题的算法[J]. 上海大学学报(自然科学版), 2022, 28(2): 226-237.

ANG Zhiqiang, WANG Tao, JIN Zhiwen. An algorithm for solving the permutation indeterminacy problem of frequency-domain ICA based on speech energy ratio[J]. Journal of Shanghai University（Natural Science Edition）, 2022, 28(2): 226-237.

图/表 10

图1

图2

图3

图4

表1

图5

图6

图7

图8

图9

参考文献 20

[1]	Jutten C, Herault J. Blind separation of sources, Part 1: an adaptive algorithm based on neuromimetic architecture[J]. Signal Processing, 1991, 24(1): 1-10. doi: 10.1016/0165-1684(91)90079-X
[2]	Comon P. Independent component analysis, a new concept?[J]. Signal Processing, 1994, 36(3): 287-314. doi: 10.1016/0165-1684(94)90029-9
[3]	吴奇昌, 马峰, 戴礼荣. 一种新的基于频域独立成分分析的语音信号盲分离方法[J]. 电路与系统学报, 2013, 18(2): 405-412.
[4]	Nesta F, Svaizer P, Omologo M. Convolutive BSS of short mixtures by ICA recursively regularized across frequencies[J]. IEEE Transactions on Audio Speech and Language Processing, 2010, 19(3): 624-639. doi: 10.1109/TASL.2010.2053027
[5]	Nesta F, Matassoni M. Blind source extraction for robust speech recognition in multisource noisy environments[J]. Computer Speech and Language, 2013, 27(3): 703-725. doi: 10.1016/j.csl.2012.08.001
[6]	Nesta F, Omologo M. Convolutive underdetermined source separation through weighted interleaved ICA and spatio-temporal source correlation[M]// Vigneron V, Zarzoso V, Gribonval R, et al. Latent variable analysis and signal separation. Berlin: Springer-Verlag, 2012: 222-230.
[7]	Sawada H, Mukai R, Araki S, et al. A robust and precise method for solving the permutation problem of frequency-domain blind source separation[J]. IEEE Transactions on Speech and Audio Processing, 2004, 12(5): 530-538. doi: 10.1109/TSA.2004.832994
[8]	Chen Z T, Chan L W. New approaches for solving permutation indeterminacy and scaling ambiguity in frequency domain separation of convolved mixtures[C]// 2011 International Joint Conference on Neural Networks. 2011: 911-918.
[9]	Kitamura D, Ono N, Sawada H, et al. Determined blind source separation unifying independent vector analysis and nonnegative matrix factorization[J]. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2016, 24(9): 1626-1641. doi: 10.1109/TASLP.2016.2577880
[10]	Sawada H, Mukai R, Araki S, et al. Polar coordinate based nonlinear function for frequency-domain blind source separation[C]// IEEE International Conference on Acoustics, Speech, and Signal Processing. 2003: I-1001-I-1004.
[11]	Mallis D, Sgouros T, Mitianoudis N. Convolutive audio source separation using robust ICA and an intelligent evolving permutation ambiguity solution[J]. Evolving Systems, 2018, 9(4): 315-329. doi: 10.1007/s12530-017-9199-3
[12]	Naik G R, Kumar D K. An overview of independent component analysis and its applications[J]. Informatica, 2011, 35(1): 63-81.
[13]	Amari S I. Natural gradient works efficiently in learning[J]. Neural Computation, 1998, 10(2): 251-276. doi: 10.1162/089976698300017746
[14]	Romano J M T, Attux R, Cavalcante C C, et al. Unsupervised signal processing: channel equalization and source separation[M]. Boca Raton: CRC Press, 2018.
[15]	Ding S, Cichocki A, Huang J, et al. Blind source separation of acoustic signals in realistic environments based on ICA in the time-frequency domain[J]. International Journal of Pervasive Computing and Communications, 2005, 1(2): 89-100. doi: 10.1108/17427370580000115
[16]	Saruwatari H, Kurita S, Takeda K, et al. Blind source separation combining independent component analysis and beamforming[J]. EURASIP Journal on Advances in Signal Processing, 2003, 2003(11): 1-12.
[17]	Ozerov A, Vincent E, Bimbot F. A general flexible framework for the handling of prior information in audio source separation[J]. IEEE Transactions on Audio, Speech and Language Processing, 2012, 20(4): 1118-1133. doi: 10.1109/TASL.2011.2172425
[18]	Vincent E, Gribonval R, Fevotte C. Performance measurement in blind audio source separation[J]. IEEE Transactions on Audio, Speech and Language Processing, 2006, 14(4): 1462-1469. doi: 10.1109/TSA.2005.858005
[19]	Rix A W, Beerends J G, Hollier M P, et al. Perceptual evaluation of speech quality (PESQ): a new method for speech quality assessment of telephone networks and codecs[C]// IEEE International Conference on Acoustics, Speech, and Signal Processing. 2001: 749-752.
[20]	Vincent E, Virtanen T, Gannot S. Audio source separation and speech enhancement[M]. Hoboken: John Wiley & Sons, 2018.

基于语音能量比的解决频域ICA次序不确定性问题的算法

An algorithm for solving the permutation indeterminacy problem of frequency-domain ICA based on speech energy ratio

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

图/表 10

参考文献 20

相关文章 2

编辑推荐

Metrics

本文评价

[1]	张叶君, 杨卫英. 基于NMF 的老电影音频背景噪声修复算法[J]. 上海大学学报(自然科学版), 2017, 23(3): 333-341.
[2]	王军华，方勇. 基于Curvelet域自适应数学形态学降噪的含噪图像盲分离方法[J]. 上海大学学报(自然科学版), 2010, 16(4): 336-341.