Automated Lip Reading: Potential to enhance accessibility in XR

Research output: Chapter in Book or Conference Publication/ProceedingConference Publicationpeer-review

Abstract

Existing research indicates that immersive technology will greatly influence the pedagogical practices in the coming years. Due to the visual nature of the XR (eXtended Reality) applications, lack of auditory support systems and high dependence on physical gestures and movements makes immersive tech inaccessible for people with special needs. However, the increasing influence and rise of the Metaverse has instigated an urgency to make XR environments accessible from the vulnerable segments of the society. Deaf and Hard of Hearing (DHH) participants often face social challenges such as illiteracy, unemployment, lack of growth in personal and professional life and social isolation. Recent advancements in Machine Learning have opened opportunities to perform Automated Lip Reading (ALR), which could be used as an assistive tool by DHH people within the Metaverse. This work in progress aspires to contribute towards the implementation of ALR systems in XR educational environments, and provide an ethically aligned design and standardization in its implementation, with ultimate aim to enhance accessibility measures in immersive technologies.

Original languageEnglish
Title of host publicationHCAIep 2023 - Proceedings of the 2023 Conference on Human Centered Artificial Intelligence - Education and Practice
Publisher Association for Computing Machinery
Pages42
Number of pages1
ISBN (Electronic)9798400716461
DOIs
Publication statusPublished - 14 Dec 2023
Event2023 Conference on Human Centered Artificial Intelligence - Education and Practice, HCAIep 2023 - Dublin, Ireland
Duration: 15 Dec 2023 → …

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2023 Conference on Human Centered Artificial Intelligence - Education and Practice, HCAIep 2023
Country/TerritoryIreland
CityDublin
Period15/12/23 → …

Keywords

  • Computer Vision
  • Deep Learning
  • EdTech
  • Extended Reality
  • Lip reading
  • Machine Learning

Fingerprint

Dive into the research topics of 'Automated Lip Reading: Potential to enhance accessibility in XR'. Together they form a unique fingerprint.

Cite this