Physics-informed Deep Deblurring: Over-parameterized Vs. Under-parameterized

CSIR-Central Electronics Engineering Research Institute (CSIR-CEERI), India
Academy of Scientific and Innovative Research (AcSIR), India
ICIP 2023

Our paper shows that lensless images can be reconstructed using under-parameterized networks with less than 10 thousand parameters. We compare the reconstruction performance with untrained over-parameterized networks having over 30 million parameters. We employ a physics-informed consistency loss function to optimize our network, leading to faster convergence and better reconstruction quality.

Abstract

Image deblurring is a classic problem in inverse computational imaging, where the blur is characterized by a kernel, known as the point spread function (PSF). For a complicated PSF, the resulting blurred image is usually incomprehensible to the human eye, such as in the case of lensless images. In this paper, we design and compare the reconstruction performance of under-parameterized and over-parameterized networks for the inverse imaging problem of lensless image reconstruction. We perform an untrained iterative reconstruction against a physics-informed loss function that requires knowledge of the forward imaging process. We conduct an extensive performance evaluation using multiple evaluation metrics and explore the obtained results contrastively by identifying the strengths and weaknesses of under-parameterization. Also, we provide reconstructions obtained using our custom PSF captured with a random diffuser.

Video Presentation

BibTeX

@inproceedings{banerjee2023physics,
                      title={Physics-Informed Deep Deblurring: Over-parameterized vs. Under-parameterized},
                      author={Banerjee, Abeer and Saurav, Sumeet and Singh, Sanjay},
                      booktitle={2023 IEEE International Conference on Image Processing (ICIP)},
                      pages={1615--1619},
                      year={2023},
                      organization={IEEE}
            }