What question did this study set out to answer?

To develop a real-time computer vision system capable of tracking and classifying infant body movements to interpret non-verbal baby communication.

June 21, 2022IEEE Sensors JournalOpen Access

BabyPose: Real-Time Decoding of Baby’s Non-Verbal Communication Using 2D Video-Based Pose Estimation

View Full Paper

Ask AI

Bookmark

Authors

MYMuhammet Mücahit Enes YurtseverKocaeli Üniversitesi SESüleyman EkenKocaeli Üniversitesi

Discussion

Member takes

Implication

Model evaluation demonstrates real-time decoding of non-verbal infant movements with high accuracy, suggesting potential for automated parenting and health monitoring tools.

Key Points

To develop a real-time computer vision system capable of tracking and classifying infant body movements to interpret non-verbal baby communication.
Curated a dataset of 156 video clips capturing six baby actions: arching back, head banging, kicking legs, rubbing eyes, stretching, and sucking fingers.
Extracted 2D body keypoints using OpenPose, AlphaPose, and KAPAO, while tracking infants in real-time with the DeepSORT algorithm.
Trained and evaluated multiple Long Short-Term Memory (LSTM) network architectures for movement classification.
The top-performing LSTM model achieved an action recognition accuracy of 99% with a loss ratio of 0.0712.
The integrated pipeline successfully tracked and classified distinct infant non-verbal communication poses in real time.

Cite This Study

Yurtsever et al. (2022) studied this question.

synapsesocial.com/papers/6a124ecd8edbaba0bf670071 https://doi.org/10.1109/jsen.2022.3183502

View Full Paper

Ask AI

Bookmark

Implication

Model evaluation demonstrates real-time decoding of non-verbal infant movements with high accuracy, suggesting potential for automated parenting and health monitoring tools.

BabyPose: Real-Time Decoding of Baby’s Non-Verbal Communication Using 2D Video-Based Pose Estimation

Discussion

Member takes

Implication

Key Points

Cite This Study

BabyPose: Real-Time Decoding of Baby’s Non-Verbal Communication Using 2D Video-Based Pose Estimation

Discussion

Member takes

Implication

Key Points

Cite This Study

Also Consider

Also Consider