Artificial intelligence-powered smart vision glasses for the visually impaired

Envision Glasses

AI-powered smartglasses that articulate everyday visual information into speech, providing independence and possibilities for people who are blind or have low vision.

Study Finds Growing Workplace Use of Smart Glasses and Generative AI Among Workers with Visual Impairments | Naric

A study funded by the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR).

Assisting blind people with AI and audio using smart glasses: system design with YOLOv8 variants comparisons

This paper introduces a novel system design leveraging Vuzix Blade 2 smart glasses to enhance the mobility and independence of visually impaired individuals. The study critically examines existing assistive navigation and object detection technologies, identifying their limitations and gaps. The designed system integrates real-time object detection, distance estimation, and OCR functionalities, providing auditory feedback through a robust and efficient pipeline. The designed application enhances the independence and safety of visually impaired individuals, particularly in navigating university campuses. A dataset comprising 15,951 annotated images from the university campus was used for training and evaluation. A comparative analysis of three YOLOv8 models (YOLOv8-N, YOLOv8-S, and YOLOv8-M) was conducted, balancing accuracy and computational efficiency to optimise system performance. The pipeline also offers a comprehensive framework for developers and researchers to build inclusive systems combining AR, computer vision, and AI. Results show high object detection accuracy (precision: 0.90, recall: 0.83) and reliable distance estimation with a minor error of 0.33 m. Results demonstrate the system’s capability to detect obstacles within one meter, provide precise distance estimation, and convert textual information into speech, validating its potential for real-world applications. This study emphasises the significant role of AI-driven solutions in advancing assistive technologies, paving the way for more accessible and inclusive navigation systems. Compared with recent assistive systems such as Smart Cane (He in CCF Trans. Pervasive Comput. Interact. 5:382–395, 2023), OrCam MyEye (Amore in J. Med. Syst. 47:11, 2023), and IrisVision (Gopalakrishnan in Comparison of visual function analysis of people with low vision using three different models of augmented reality devices, 2024), the proposed system demonstrates superior integration of detection, text recognition, and real-time feedback within a lightweight wearable device.

How AI Glasses Are Empowering People With Disabilities

Our AI glasses are empowering people with disabilities to perform daily tasks with greater independence.

Smart Glasses for Disabled People

This paper introduces an innovative assistive technology aimed at improving the quality of life for individuals with visual impairments. This project presents a system that combines the capabilities You Only Look Once [6] (YOLO) deep learning algorithm with the ESP32 [7] microcontroller to create Object Detection Glasses. These glasses employ real-time object detection to provide users with auditory feedback about their surroundings, enabling them to navigate and interact with their environment more independently. The first task of the glasses is to take pictures of the object and store it as a snap. The second task is that they compare the captured image to the existing image. In order to convert the text into speech, it used Text to Speech technology (TTS). The picture will be taken by ESP 32 with the perfect size the image will be displayed and then by using the speaker the object will be detected. The integration of YOLO [6] and ESP32 [7] offers a cost-effective and efficient solution for enhancing accessibility and inclusivity, promoting greater autonomy and safety for individuals with visual disabilities.

YOLOv8-Based XR Smart Glasses Mobility Assistive System for Aiding Outdoor Walking of Visually Impaired Individuals in South Korea

This study proposes an eXtended Reality (XR) glasses-based walking assistance system to support independent and safe outdoor walking for visually impaired people. The system leverages the YOLOv8n deep learning model to recognize walkable areas, public transport facilities, and obstacles in real time and provide appropriate guidance to the user. The core components of the system are Xreal Light Smart Glasses and an Android-based smartphone, which are operated through a mobile application developed using the Unity game engine. The system divides the user’s field of vision into nine zones, assesses the level of danger in each zone, and guides the user along a safe walking path. The YOLOv8n model was trained to recognize sidewalks, pedestrian crossings, bus stops, subway exits, and various obstacles on a smartphone connected to XR glasses and demonstrated an average processing time of 583 ms and an average memory usage of 80 MB, making it suitable for real-time use. The experiments were conducted on a 3.3 km route around Bokjeong Station in South Korea and confirmed that the system works effectively in a variety of walking environments, but recognized the need to improve performance in low-light environments and further testing with visually impaired people. By proposing an innovative walking assistance system that combines XR technology and artificial intelligence, this study is expected to contribute to improving the independent mobility of visually impaired people. Future research will further validate the effectiveness of the system by integrating it with real-time public transport information and conducting extensive experiments with users with varying degrees of visual impairment.

Smart glasses for remote assistance: analysing usability and optimal user characteristics among young adults with and without autism

Young adults with autism spectrum disorder (ASD) often face challenges achieving independence and require ongoing support from caregivers. Smart glasses can develop skills and provide remote suppor...

The influence of artificial intelligence on individuals with disabilities

The rapid advancement of artificial intelligence (AI) is reshaping assistive technologies, offering new possibilities for enhancing the independence, …

Smart Glasses for Older Adults With Cognitive Impairment: A Scoping Review

This study aimed to identify and synthesize peer-reviewed literature on smart glasses for older adults with cognitive impairment. The review focused on (1) the technology and equipment used, (2) the specific tasks smart glasses are designed to support, (3) feasibility outcomes, when measured, and (4) the quality of the reviewed articles.

The influence of artificial intelligence on individuals with disabilities

The rapid advancement of artificial intelligence (AI) is reshaping assistive technologies, offering new possibilities for enhancing the independence, communication and quality of life of individuals with disabilities. This study presents a qualitative scoping review of 47 peer-reviewed articles published between 2018 and 2025, examining how AI has been integrated into assistive tools across domains such as mobility, communication, cognitive support, education and independent living. Specific AI applications include object recognition, gesture-based control, navigation assistance, emotion detection and natural language processing. The review highlights significant progress in personalization and real-time adaptation, while also identifying persistent challenges such as algorithmic bias, cost barriers, data privacy concerns and unequal access, particularly in low-resource settings. Ethical considerations and the need for inclusive, user-centered design approaches are emphasized. The study also underscores future research priorities, including standardization of development protocols, empirical evaluation of long-term effectiveness and policy frameworks to ensure equitable access. By synthesizing recent developments and critical gaps, this review contributes to understanding how AI can responsibly and effectively support assistive technologies, ultimately promoting more inclusive environments for people with disabilities.

Artificial intelligence-powered glasses could be a gamechanger for those with hearing loss | About | University of Stirling

A project building on a 2015 University of Stirling study could harness AI to support those with hearing loss

(PDF) Smart glasses for remote assistance: analysing usability and optimal user characteristics among young adults with and without autism

PDF | Purpose: Young adults with autism spectrum disorder (ASD) often face challenges achieving independence and require ongoing support from... | Find, read and cite all the research you need on ResearchGate

SpecAssist: Smart Glasses with Real-time speech recognition and transcription for the hearing impaired

Download Reference Data on IJERT | On 01-07-2023 by Noel Jacob, Rajat Mathew, Sathwik P Nair, Prof. Divya Sunny published SpecAssist: Smart Glasses with Real-time speech recognition and transcription for the hearing impaired

Ubiquitous Accessibility for People with Visual Impairments: Are We There Yet?

Ubiquitous access is an increasingly common vision of computing, wherein users can interact with any computing device or service from anywhere, at any time. In the era of personal computing, users with visual impairments required special-purpose, assistive technologies, such as screen readers, to interact with computers. This paper investigates whether technologies like screen readers have kept pace with, or have created a barrier to, the trend toward ubiquitous access, with a specific focus on desktop computing as this is still the primary way computers are used in education and employment. Towards that, the paper presents a user study with 21 visually-impaired participants, specifically involving the switching of screen readers within and across different computing platforms, and the use of screen readers in remote access scenarios. Among the findings, the study shows that, even for remote desktop access—an early forerunner of true ubiquitous access—screen readers are too limited, if not unusable. The study also identifies several accessibility needs, such as uniformity of navigational experience across devices, and recommends potential solutions. In summary, assistive technologies have not made the jump into the era of ubiquitous access, and multiple, inconsistent screen readers create new practical problems for users with visual impairments.

How useful are smart glasses in improving accessibility in higher education?

Smart glasses have the potential to support learning for disabled students, but this technology also comes with significant privacy concerns. Helen Nicholson-Benn looks at how to balance functional benefits with data security and safeguarding