中文

Journal of Shanghai University >

2022 , Vol. 28 >Issue 2: 250 - 260

DOI: https://doi.org/10.12066/j.issn.1007-2861.2276

Research Articles

Just-noticeable distortion model based on colour complexity and structure tensor

Expand
  • School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China

Received date: 2020-05-21

  Online published: 2021-05-10

Fold

Abstract

The just noticeable distortion (JND) threshold refers to the minimum distortion at which eyes can perceive. JND can be used to remove visual redundancy derived from image or video compression. Considering that JND models do not make full use of colour features and structural information, this study proposes a JND model based on colour complexity and structure tensor. First, the colour complexity is estimated and it is used to calculate the visual weight values related to the sensitivity of human eyes. Then the estimated colour complexity is combined with the contrasting masking effect to improve the accuracy of the model. Next, utilising the local structure tensor to represent local features, the modulation factor is established to calculate the visual redundancy of irregular regions. Finally, the colour complexity structure tensor based JND (CSJND) model is estimated by combining the colour-complexity-based JND model and structure tensor modulation factor. Experimental results show that the proposed CSJND model can acquire a noticeably lower peak-signal-to-noise ratio as compared with some existing JND models while also achieving the same subjective perceptual quality. This is more consistent with human visual perception. The proposed CSJND model can also calculate the JND thresholds more accurately.

Key words： just noticeable distortion (JND) model; colour complexity; structure tensor

Cite this article

WANG Chuang, WANG Yongfang, LIAN Junjie . Just-noticeable distortion model based on colour complexity and structure tensor[J]. Journal of Shanghai University, 2022 , 28(2) : 250 -260 . DOI: 10.12066/j.issn.1007-2861.2276

References

[1] Yuan D, Zhao T, Xu Y, et al. Visual JND: a perceptual measurement in video coding[J]. IEEE Access, 2019, 7: 29014-29022.
[2] Li J, Zhang H, Wang J, et al. Orientation-aware saliency guided JND model for robust image watermarking[J]. IEEE Access, 2019, 7: 41261-41272.
[3] Su H, Jung C. Perceptual enhancement of low light images based on two-step noise suppression[J]. IEEE Access, 2018, 6: 7005-7018.
[4] Qi F, Zhao D, Fan X, et al. Stereoscopic video quality assessment based on visual attention and just-noticeable difference models[J]. Signal Image & Video Processing, 2016, 10(4): 737-744.
[5] Yang X K, Ling W S, Lu Z K, et al. Just noticeable distortion model and its applications in video coding[J]. Signal Processing Image Communication, 2005, 20(7): 662-680.
[6] Liu A, Lin W, Paul M, et al. Just noticeable difference for images with decomposition model for separating edge and textured regions[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2010, 20(11): 1648-1652.
[7] Wu J, Shi G, Lin W, et al. Just noticeable difference estimation for images with free-energy principle[J]. IEEE Transactions on Multimedia, 2013, 15(7): 1705-1710.
[8] Wu J, Li L, Dong W, et al. Enhanced just noticeable difference model for images with pattern complexity[J]. IEEE Transactions on Image Processing, 2017, 26: 2682-2693.
[9] Zeng Z, Zenga H, Chen J, et al. Visual attention guided pixel-wise just noticeable difference model[J]. IEEE Access, 2019, 7: 132111-132119.
[10] Wei Z, Ngan K. Spatio-temporal just noticeable distortion profile for grey scale image/video in DCT domain[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2009, 19(3): 337-346.
[11] Wan W, Wu J, Xie X, et al. A novel just noticeable difference model via orientation regularity in DCT domain[J]. IEEE Access, 2017, 5: 22953-22964.
[12] Wang H K, Yu L, Li T S, et al. A DCT-JND profile for disorderly concealment effect[C]// Advances in Multimedia Information Processing. 2018: 188-199.
[13] Wang H K, Li Y, Wang S, et al. A novel foveated-jnd profile based on an adaptive foveated weighting model[C]// 2018 IEEE Visual Communications and Image Processing (VCIP). 2018: 1-4.
[14] Ki S, Bae S H, Kim M, et al. Learning-based just-noticeable-quantization- distortion modeling for perceptual video coding[J]. IEEE Transactions on Image Processing, 2018, 27: 3178-3193.
[15] Liu H, Zhang Y, Zhang H, et al. Deep learning based picture-wise just noticeable distortion prediction model for image compression[J]. IEEE Transactions on Image Processing, 2019, 29: 641-656.
[16] Pian Z, Lu P P, Wu L X, et al. A new image segmentation approach with structure tensor and random walk[C]// 2008 Second International Symposium on Intelligent Information Technology Application. 2008: 432-436.
[17] Landstrom A, Thurley M J. Adaptive morphology using tensor-based elliptical structuring elements[J]. Pattern Recognition Letters, 2013, 34(12): 1416-1422.
[18] Anders L. An approach to adaptive quadratic structuring functions based on the local structure tensor[C]// International Symposium on Mathematical Morphology and Its Applications to Signal and Image Processing. 2015.
[19] 许爽. 基于颜色特征的图像复杂度研究[D]. 开封: 河南大学, 2016.
[20] Wang J, Wan W B, Li X X, et al. Color image watermarking based on orientation diversity and color complexity[J]. Expert Systems with Application, 2020, 140: 112868.
[21] Chen H, Hu R, Hu J, et al. Temporal color just noticeable distortion model and its application for video coding[C]// Proceedings of the 2010 IEEE International Conference on Multimedia and Expo. 2010.
[22] 于永健, 王向阳, 吴俊峰. 基于颜色复杂度的加权颜色直方图图像检索算法[J]. 小型微型计算机系统, 2009, 30(3): 507-511.
[23] Wu J, Lin W, Shi G, et al. Pattern masking estimation in image with structural uncertainty[J]. IEEE Transactions on Image Processing, 2013, 22(12): 4892-4904.
[24] 赵高鹏, 李磊, 王建宇. 基于结构张量分析的弱小目标单帧检测[J]. 光子学报, 2019, 48(1): 135-145.
[25] Ma C, Lü X, Ao J. Difference based median filter for removal of random value impulse noise in images[J]. Multimedia Tools and Applications, 2019, 78(1): 1131-1148.
Options
Outlines

/

〈 〉