轻量化神经网络和哈希跟踪算法在嵌入式人脸抓拍系统中的应用

doi:10.12066/j.issn.1007-2861.2187

Abstract

Abstract:

To address the difficulty of balancing the speed and accuracy of face capture systems embedded in mobile devices, a fast and accurate embedded face capture system is designed based on the combination of a lightweight neural network and a Hash tracking algorithm. Firstly, an optimised face detection network is constructed based on the lightweight MobileNet solid state disk (SSD) object detector. After pruning and face alignment, a Hash algorithm is combined to track a face based on the average Hash (aHash) and a perceptual Hash (pHash) design, in which the key point distance and face size as well as the four-direction Sobel operator are used as the three standards to extract the best face image. Finally, MobileFaceNet is applied to identify the best face. The experimental results indicate that the speed of the proposed face detection algorithm is increased by 22.6% compared to using the standard MobileNet SSD. Furthermore, compared with using only the mean Hash or the pHash algorithm, the matching accuracy is improved by 21.7% and 10.1% when the combined Hash algorithm is applied, respectively. The face capture accuracy is greater than 95%, and the capture speed can reach 28 frame/s.

Key words: face capture, embedded, Hash tracking, deep learning

CLC Number:

XU Genglin, RAN Feng, DENG Liang, SHI Huakang, GUO Aiying. Application of lightweight neural network and Hash tracking algorithm in embedded face capture system[J]. Journal of Shanghai University（Natural Science Edition）, 2021, 27(6): 1018-1028.

Figures/Tables 16

Fig.1

Fig.2

Fig.3

Fig.4

Table 1

Fig.5

Table 2

Table 3

Table 4

Table 5

Table 6

Fig.6

Table 7

Fig.7

Fig.8

Table 8

References 14

[1]	Ren S Q, He K M, Ross G, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Trans on Pattern Anal Mach Intell, 2015, 39(6): 1137-1149. doi: 10.1109/TPAMI.2016.2577031
[2]	He K, Zhang X, Ren S, et al. Deep residual learning for image recognition[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016: 770-778.
[3]	Zhang K, Zhang Z, Li Z, et al. Joint face detection and alignment using multi-task cascaded convolutional networks[J]. Signal Processing Letters, 2016, 23(10): 1499-1503. doi: 10.1109/LSP.2016.2603342
[4]	Deng J, Guo J, Xue N, et al. ArcFace: additive angular margin loss for deep face recog-nition[C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019: 4690-4699.
[5]	Howard A G, Zhu M, Chen B, et al. Mobilenets: efficient convolutional neural networks for mobile vision applications [EB/OL]. (2017-04-17) [2019-08-10]. https://arxiv.org/abs/1704.04861.
[6]	Zhang X, Zhou X, Lin M, et al. Shufflenet: an extremely efficient convolutional neural network for mobile devices[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018: 6848-6856.
[7]	Liu C M, Wu K G. A single kalman filtering algorithm for maneuvering target tracking[J]. Aeousties, Speech, and Signal Proeessing, 1994, 6:193-196.
[8]	Yu F W, Li W B, Li Q Q, et al. Multiple object tracking with high performance detection and appearance feature[C]// European Conference on Computer Vision. 2016: 36-42.
[9]	Bochinski E, Eiselein V, Sikora T. High-speed tracking-by-detection without using image information[C]// Proceedings of IEEE International Conference on Advanced Video and Signals-based Surveillance. 2017: 1-6.
[10]	Hilke K, Hubner W, Michael A. Joint detection and online multi-object tracking[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018: 1540-1548.
[11]	Liu W, Anguelov D, Erhan D, et al. SSD: single shot multibox detector[C]// European Conference on Computer Vision. 2016: 21-37.
[12]	钱青, 臧冬菊. 一种改进的 Sobel 算子图像清晰度评价函数[J]. 计算机与数字工程, 2015, 43(10): 1865-1870.
	Qian Q, Zang D J. A modified sharpness-evaluation function of image based on Sobel[J]. Computer and Digital Engineering, 2015, 43(10): 1865-1870.
[13]	Chen S, Liu Y, Gao X, et al. MobileFaceNets: efficient CNNs for accurate real-time face verification on mobile devices [EB/OL]. (2018-06-15) [2019-08-18]. https://arxiv.org/abs/1804.07573.
[14]	郭仪权. 基于哈希的多目标跟踪算法的研究[D]. 合肥: 安徽大学, 2017.
	Guo Y Q. Research on multiple target tracking algorithm based on Hash[D]. Hefei: Anhui University, 2017.

Application of lightweight neural network and Hash tracking algorithm in embedded face capture system

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 16

References 14

Related Articles 11

Recommended Articles

Metrics

Comments

[1]	XING Yixue, ZHU Yonghua, GAO Haiyan, ZHOU Jin, ZHANG Ke. Distant supervision for relation extraction via attention CNNs [J]. Journal of Shanghai University（Natural Science Edition）, 2021, 27(5): 983-992.
[2]	SHAO Huixiang, ZENG Dan. Classification and recognition of underwater small targets based on improved YOLOv3 algorithm [J]. Journal of Shanghai University（Natural Science Edition）, 2021, 27(3): 481-491.
[3]	CHEN Yu, DING Youdong, YU Bing, XU Min. Video colourisation based on voxel flow [J]. Journal of Shanghai University（Natural Science Edition）, 2021, 27(1): 18-27.
[4]	Jiacheng HU, Xiangyang WANG, Han LIU. Defect detection of continuous casting slabs based on deep learning [J]. Journal of Shanghai University（Natural Science Edition）, 2019, 25(4): 445-452.
[5]	XIE Zhifeng, YE Guanhua, YAN Shuqi, HE Shaorong, DING Youdong. HDR image style transfer technique based on generative adversarial networks [J]. Journal of Shanghai University（Natural Science Edition）, 2018, 24(4): 524-534.
[6]	LANG Yue1, ZHOU Jiting1, LIANG Xiaolong2, ZHANG Wenjun1. Automatic annotation for film and Television drama shots and recut system based on face identification [J]. Journal of Shanghai University（Natural Science Edition）, 2017, 23(3): 353-363.
[7]	SHEN Wenfeng, ZHANG Jianlei, ZHOU Dingqian, CHEN Shengbo, QIU Feng. Recognition of Chinese characters on license plates based on big data [J]. Journal of Shanghai University（Natural Science Edition）, 2016, 22(1): 88-96.
[8]	WANG Zhi-heng, JIN Yi, OUYANG Shan. Implementation and improvement of SD11 decoder [J]. Journal of Shanghai University（Natural Science Edition）, 2015, 21(2): 245-256.
[9]	CHEN Jun-li, QING Ding-hu, LI Xiang, WAN Wang-gen. Set Partitioning in Hierarchical Trees Algorithm for Color Images Based on Multiwavelet [J]. Journal of Shanghai University（Natural Science Edition）, 2011, 17(1): 39-43.
[10]	GUO Peng-Fei, WEI Xian-Biao. Normally Embedded Subgroups of Finite Groups [J]. Journal of Shanghai University（Natural Science Edition）, 2009, 15(5): 496-500.
[11]	LI Wei,PAN Zhi-hao,WANG Min. Moving Object Capture Based on Characteristics of APS-CMOS Image Sensor [J]. Journal of Shanghai University（Natural Science Edition）, 2009, 15(1): 47-50.