Journal of Shanghai University(Natural Science Edition) ›› 2025, Vol. 31 ›› Issue (3): 530-542.doi: 10.12066/j.issn.1007-2861.2663

• Communication Engineering • Previous Articles     Next Articles

Dense light field decoupling reconstruction based on multiscale EPI fusion

CAO Jie1,2, WU Yujing3, ZHANG Qian1,2, MENG Chunli1, YAN Tao4   

  1. 1. The College of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai 200234, China;
    2. Shanghai Engineering Research Center of Intelligent Education and Bigdata, Shanghai 200234, China;
    3. High School Affiliated to Fudan University, Shanghai 200433, China;
    4. School of Artificial Intelligence, Putian University, Putian 351100, Fujian, China
  • Received:2024-10-22 Online:2025-06-30 Published:2025-07-22

Abstract: To fully exploit the inherent correlation between light field epipolar plane images(EPI) and strengthen the effective capture of spatial information, this study proposed a dense light field decoupling reconstruction method based on multiscale EPI information fusion. This method utilized the spatial and epipolar plane dimensions to enable a better capture of the angular correlations between subaperture views. By decoupling and fusing multiple types of information, the accuracy and effectiveness of light field reconstruction could be enhanced. First, based on four-dimensional light field data, additional dense spatial dimensions were introduced to improve the generalization capability of the network and enhanced its understanding of local structures and texture details in images. Second, to better complement and enhance the mutual information among epipolar planes, an epipolar plane fusion module was designed along with a novel multiscale convolutional attention mechanism to integrate feature information. This attention mechanism effectively captured angular correlations through multiscale feature extraction and a global attention mechanism, thereby enhancing the expression of critical features while suppressing redundant content. Finally, experiments conducted on light field datasets, such as HCInew, HCIold,and Stanford, demonstrated that the proposed method outperformed existing state-of-theart(SOTA) approaches in terms of evaluation metrics including the peak signal-to-noise ratio(PSNR) and structural similarity(SSIM). The proposed method achieved superior reconstruction performance in most test scenarios.

Key words: light field, light field decoupling, dense feature extraction, epipolar plane images(EPI) fusion, angular super-resolution

CLC Number: