Lensless fiber imaging using deep neural networks and quantum technology

Minimally invasive endoscopic imaging is indispensable for several important biomedical imaging applications such as in neurology. However, traditional fiber-optic endoscopes require bulky lens systems that typically enable 2D imaging only. Unconventional imaging using a diffuser for encoding 3D objects into 2D speckle patterns is presented. A multicore fiber transmits the speckle intensity information of fluorescent light from biological tissue. The decoding of the speckle pattern is accomplished by neural networks with a combination of U-Net and single-layer perceptron. It turns out 3D image reconstruction at almost video rate. The diffuser fiber endoscope is promising for in vivo deep brain diagnostics with cellular resolution and keyhole access. Advances in physics-informed neural networks and quantum imaging with entangled photons are also outlined. In conclusion, unconventional lensless imaging using multicore fibers, deep learning and quantum imaging is highlighted as paradigm shift for biomedicine.