PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 2, 2026Cureus0 citationsOpen Access

Real-Time Estimation of Numerical Rating Scale (NRS) Scores Using Machine Learning-Based Facial Expression Analysis: A Proof-of-Concept Study

KUKentaro UejimaTTTsutomu TakahashiMMMiki Matsui

Key Points

  • This study aims to develop a real-time pipeline for estimating Numerical Rating Scale (NRS) scores based on facial expression analysis.
  • Implemented a real-time analysis pipeline using Python, integrating MediaPipe and DeepFace for facial and emotion detection.
  • Used seven emotion probability scores from 30 fps video streams as predictors for NRS estimation via regression models, including Random Forest.
  • Synthetic datasets were evaluated using leave-one-out cross-validation (LOOCV) to assess model performance.
  • In the pediatric dataset, the RF model achieved a Spearman’s rank correlation coefficient (ρ) of 0.7383 (p < 0.001) with a mean absolute error (MAE) of 1.5195, outpacing the baseline model (ρ = 0.2765).
  • In the elderly dataset, the RF model achieved ρ = 0.7566 (p < 0.001) and MAE = 1.5760.
  • Feature importance analysis found that 'Fear' was significant in both datasets, while 'Neutral' was notably important in the elderly dataset.

Abstract

Background Accurate pain assessment is fundamental to effective cancer pain management. However, subjective scales such as the Numerical Rating Scale (NRS) have limitations in pediatric and elderly patients with impaired verbal communication. This study aimed to develop a real-time facial expression-based pipeline for NRS estimation and to evaluate its technical feasibility as a proof of concept (PoC). Methods A real-time analysis pipeline was implemented in Python (version 3.11; Python Software Foundation, Fredericksburg, VA, USA), integrating MediaPipe for facial detection and DeepFace for emotion estimation. Seven emotion probability scores extracted from 30 fps video streams were used as predictor variables to estimate NRS values using several regression models, including Random Forest (RF). Synthetic datasets generated for technical validation were evaluated using leave-one-out cross-validation (LOOCV). Performance was assessed using Spearman’s rank correlation coefficient (ρ) and mean absolute error (MAE). Results In the pediatric dataset, the RF model achieved ρ = 0.7383 (p < 0.001) and MAE = 1.5195, demonstrating improved performance compared with the baseline model (ρ = 0.2765). In the elderly dataset, the RF model showed ρ = 0.7566 (p < 0.001) and MAE = 1.5760. Feature importance analysis indicated that “Fear” contributed prominently in both datasets, whereas “Neutral” also showed relatively higher importance in the elderly dataset. Conclusions This study demonstrated the technical feasibility of a real-time NRS estimation pipeline using artificial intelligence (AI)-based facial expression analysis. The findings suggest potential applicability as a complementary pain assessment approach for patients with limited verbal communication, pending future clinical validation.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Uejima et al. (2026) studied this question.

synapsesocial.com/papers/69f593f271405d493affebefhttps://doi.org/10.7759/cureus.107883
Ask AI
Helpful
Bookmark
Share
View Full Paper