figshare
Browse
1/1
2 files

Unwrapping Non-Locality in the Image Transmission Through Turbid Media

preprint
posted on 2024-02-15, 07:37 authored by Mohammadrahim Kazemzadeh, Liam Collard, Linda Piscopo, Filippo Pisano, Cristian Ciraci, Massimo De Vittorio, Ferruccio Pisanello
Achieving high-fidelity image transmission through turbid media is a significant challenge facing both the AI and photonic/optical communities. While this capability holds promise for a variety of applications, including data transfer, neural endoscopy, and multi-mode optical fiber-based imaging, conventional deep learning methods struggle to capture the nuances of light propagation, leading to weak generalization and limited reconstruction performance. To address this limitation, we investigated the non-locality present in the reconstructed images and discovered that conventional deep learning methods rely on specific features extracted from the training dataset rather than meticulously reconstructing each pixel. This suggests that they fail to effectively capture long-range dependencies between pixels, which are crucial for accurate image reconstruction. Inspired by the physics of light propagation in turbid media, we developed a global attention mechanism to approach this problem from a broader perspective. Our network harnesses information redundancy generated by peculiar non-local features across the input and output fiber facets. This mechanism enables a two-order-of-magnitude performance boost and high fidelity to the data context, ensuring accurate representation of intricate details in a pixel-to-pixel reconstruction rather than mere loss minimization.

History

Preprint ID

111814

Usage metrics

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC