Enhancing the Haar Cascade Algorithm for Robust Detection of Facial Features in Complex Conditions Using Area Analysis and Adaptive Thresholding

Facial features are critical visual indicators for understanding what a person is experiencing, providing valuable insights into their emotions and physical states. However, accurately detecting these features under diverse conditions remains a significant challenge, especially in computationally constrained environments. This paper presents a facial feature extraction method designed to identify regions of interest for detecting facial cues, with a focus on improving the accuracy of eye and mouth detection. Addressing the limitations of standard Haar cascade classifiers, particularly in challenging scenarios such as droopy eyes, red eyes, and droopy mouths, this method introduces a correction algorithm rooted in normal human facial anatomy, emphasizing symmetry and consistent feature placement. By integrating this correction algorithm with a feature-based refinement process, the proposed approach enhances detection accuracy from 67.22% to 96.11%. Through this method, the accurate detection of facial features like the eyes and mouth is significantly improved, offering a lightweight and efficient solution for real-time applications while maintaining computational efficiency.