MGScoliosis: Multi-grained scoliosis detection with joint ordinal regression from natural image

Scoliosis is among the most prevalent diseases affecting teenagers. However, traditional scoliosis screening methods often resort to physical examination or radiographic imaging. The two ways both rely on experts with high costs, which are not suitable for wide-range screening. Besides, estimating Cobb angle level only using natural images are challenging. To tackle these issues, we propose a multi-grained scoliosis detection framework by jointly estimating severity level and Cobb angle level of scoliosis from a natural image instead of a radiographic image, which has not been explored before. Specifically, we regard scoliosis estimation as an ordinal regression problem, and transform it into a series of binary classification sub-problems. Besides, we adopt the visual attention network with large kernel attention as the backbone for feature learning, which can model local and global correlations with efficient computations. The feature learning and the ordinal regression is put into an end-to-end framework, in which the two tasks of scoliosis severity level estimation and scoliosis angle level estimation are jointly learned and can contribute to each other. Extensive experiments demonstrate that our approach outperforms state-of-the-art methods as well as human performance, which provides a promising and economical solution to wide-range scoliosis screening. Particularly, our approach achieves accuracies of 94.90% and 79.62% in estimating severity level and Cobb angle level, improving large margins of 4.90% and 12.15% over existing natural image based scoliosis detection performance, respectively. The code is available at https://github.com/RuiChen-stack/MGScoliosis .