Reconstruction of continuum robots by marker-free shape registration of image data using a kinematic model

Continuum robots are slender, flexible manipulators that navigate confined, curved workspaces and are gaining traction in aerospace, inspection, automation, and minimally invasive medical applications. Predicting their shape from physics-based models alone remains challenging, making accurate measurement of the deformed backbone essential for model validation and reference-data acquisition. We present an optimisation-based shape-registration algorithm that fits a parametric three-dimensional curve directly to image observations within a photogrammetric pipeline, targeting marker-free measurement rather than sensing under occlusion. By matching reconstruction points to robot pixels, the method requires no prior knowledge of the robot’s location in each image. Across most configurations, the estimated backbone deviates from ground truth by less than [Formula: see text] ([Formula: see text] of the robot’s length). On real concentric-tube continuum robots, the reconstruction agrees with ten discrete manual photogrammetric measurements over 18 configurations, while replacing the manual procedure with an automated pipeline that runs in roughly [Formula: see text] per configuration.