End-to-end physics-informed multi-branch GAN for enhanced DoFP polarization image reconstruction

doi:10.1364/OE.547918

Details of Research Outputs

Title	End-to-end physics-informed multi-branch GAN for enhanced DoFP polarization image reconstruction
Creator	Liu，Haoran 1; Gu，Zhongding 2,3; Shi，Shuming 2,3; Li，Zhenyang 2,3; Lei，Xuefeng 2,3; Liu，Zhenhai 2,3; Song，Maoxin 2,3; Yang，Jie 4; Li，Congfei 2,3; Zhou，Zhiyuan 1; Qiu，Zhenwei 2,3; Hong，Jin 2,3
Date Issued	2025-02-24
Source Publication	Optics Express
Volume	33 Issue:4 Pages:7684-7704
Abstract	Division-of-focal plane (DoFP) polarimeters deploying micro-polarizer array as the polarization state analyzer (PSA) possess the capacity to capture polarization properties of the scene target during a single snapshot and benefit from their rugged and compact designs. However, these systems acquire polarization measurements through spatial modulation, leading to inevitable spatial resolution loss and reduction in polarimetric accuracy. To overcome these challenges, we propose, to our knowledge, a novel approach by leveraging an end-to-end physics-informed residual generative adversarial network (GAN) for DoFP polarization image reconstruction. Our method enhances the reconstruction of intensity (I), degree of linear polarization (DoLP) and angle of polarization (AoP) directly from DoFP polarization images bypassing traditional interpolation methods that rely on interpolating intensity images from different polarization orientations. The network’s architecture is tailored to simultaneously handle demosaicking and polarimetric reconstruction, thereby mitigating the inherent limitations of DoFP systems. Additionally, we utilize Grad-CAM for model interpretability, allowing us to visualize and understand the regions of the input images that the network focuses on during reconstruction. Experimental results demonstrate that our approach improves the quality of the reconstructed polarization images and enhances overall polarization accuracy.
DOI	10.1364/OE.547918
URL	View source
Language	英语English
Scopus ID	2-s2.0-85218492236
Citation statistics
Document Type	Journal article
Identifier	http://repository.uic.edu.cn/handle/39GCC9TT/12504
Collection	Beijing Normal-Hong Kong Baptist University
Affiliation	1.Department of Optics and Optical Engineering,University of Science and Technology of China,Hefei,230026,China 2.Anhui Institute of Optics and Fine Mechanics,Hefei Institutes of Physical Science,Chinese Academy of Sciences,Hefei,230031,China 3.Key Laboratory of Optical Calibration and Characterization,Chinese Academy of Sciences,Hefei,230031,China 4.Department of Faculty of Science and Technology,BNU-HKBU United International College,Zhuhai,519087,China
Recommended Citation GB/T 7714	Liu，Haoran,Gu，Zhongding,Shi，Shuminget al. End-to-end physics-informed multi-branch GAN for enhanced DoFP polarization image reconstruction[J]. Optics Express, 2025, 33(4): 7684-7704.
APA	Liu，Haoran., Gu，Zhongding., Shi，Shuming., Li，Zhenyang., Lei，Xuefeng., .. & Hong，Jin. (2025). End-to-end physics-informed multi-branch GAN for enhanced DoFP polarization image reconstruction. Optics Express, 33(4), 7684-7704.
MLA	Liu，Haoran,et al."End-to-end physics-informed multi-branch GAN for enhanced DoFP polarization image reconstruction". Optics Express 33.4(2025): 7684-7704.

Files in This Item:
There are no files associated with this item.

Related Services

Usage statistics

Google Scholar

If you have any objections to this item, please fill out the form below and the administrator will contact you as soon as possible.
Content:
Email：	*
Institution:
Verification Code:	Refresh

Any comments and suggestions are welcomed.
Title:	*
Content:
Email：	*
Verification Code:	Refresh