Human–Computer Interaction (HCI) has evolved significantly with the advancement of Artificial Intelligence and Computer Vision technologies. Traditional input devices such as mouse and touchpads require physical interaction, which may not be suitable for individuals with physical disabilities or in touchless environments. This paper presents a real-time Virtual Cursor Control system using eye tracking and hand gestures. The system uses a standard webcam to detect iris movement for cursor navigation and hand gestures for performing mouse operations such as clicking, scrolling, and dragging. Eye tracking is implemented using MediaPipe FaceMesh, while hand gesture recognition is achieved using MediaPipe Hands. The system eliminates the need for specialized hardware, making it cost-effective and accessible. Experimental results demonstrate high accuracy (up to 90–95% for gesture recognition and ~85–90% for eye tracking) with minimal latency, making it suitable for real-time applications in accessibility systems, healthcare environments, and touchless computing.
Anjum et al. (Thu,) studied this question.