A compact system for multimodal optical tissue analysis via integrated stereo and hyperspectral imaging

In this study, we present an integrated stereoscopic and hyperspectral imaging system designed to overcome the limitations of traditional quantitative hyperspectral imaging, notably the dependency on precise camera-sample distance measurements. Our approach combines advanced depth-sensing technology with a compact hyperspectral camera, featuring integrated RGB sensors, to facilitate automated synchronization, system integration, and reconstruction through epipolar geometry and image co-registration. The system acquires hyperspectral data cubes along predefined camera trajectories, enabling full 3D hyperspectral representations via global alignment, a significant enhancement over conventional methods that lack depth resolution. This methodology has the potential to eliminate the need for strict camera-sample distance calibration and appends a morphological dimension to hyperspectral tissue analysis. The system's efficacy is demonstrated in vivo, focusing on non-contact human skin imaging. The integration of stereoscopic depth and hyperspectral data in our system marks a significant advancement in spectroscopic tissue analysis, with promising applications in telehealth, enhancing both the diagnostic capabilities and accessibility of advanced imaging technologies.