Seeing with AI: Transforming Lives through Smart Glasses for the Blind and Visually Impaired (BVI)

People with visual impairment encounter numerous challenges in daily life, hindering their ability to move freely and independently.To address this, artificial intelligence and computer vision technologies offer promising solutions aimed at enhancing the satisfaction and autonomy of the Blind and Visually Impaired (BVI) community.Smart glasses represent a groundbreaking innovation facilitating independent travel and fostering social inclusion and well-being among individuals with visual impairments.However, navigating alone, especially in low-light or nighttime conditions, remains a significant obstacle for the BVI population.In this study, we propose an intelligent framework leveraging computer vision techniques tailored specifically for BVI individuals.The framework incorporates deep learning models, robust evaluation methodologies, and an open development approach.Comprising four key models, including low-light image enhancement, object recognition with transformer encoder/decoder, significant item extraction, and text-to-speech functionality, this framework aims to provide comprehensive assistance to BVI individuals during travel and navigation.Key features of the framework include enhancing image quality in low-light environments, facilitating understanding of audio inputs with a wide range of sound recognition, and extracting crucial visual information for improved navigation and situational awareness.Through rigorous evaluation, the framework demonstrates remarkable performance across challenging low-light and ultra-dark datasets, promising significant advancements in assisting BVI individuals in overcoming mobility barriers and achieving greater independence The framework emphasizes material design principles to ensure user-friendliness and accessibility.By employing intuitive interfaces and tactile feedback mechanisms, the system enhances usability and user engagement, catering to the unique needs and preferences of BVI individuals.Furthermore, continuous refinement and updates based on user feedback foster a collaborative and iterative development process, ensuring that the technology evolves to meet evolving challenges and user requirements effectively.Through interdisciplinary collaboration and a human-centered design approach, the proposed framework represents a significant step towards empowering BVI individuals, enabling them to navigate the world with greater confidence, independence, and dignity.