Publication · Journal article
Prajwal Narayanaswamy, Abbas Attarwala, Paul Viotti, Jaime Raigoza, Ed Lindoo
Journal of Computing Sciences in Colleges, 41(4), 77–89 · September 2025 · Consortium for Computing Sciences in Colleges · ACM Digital Library
Abstract
Conventional screen readers vocalize code linearly, word by word, and often fail to convey the contextual relationships and structural hierarchy that are fundamental to program comprehension. The paper proposes a system that uses an OpenAI large language model, guided by carefully engineered prompts, to turn source code into structured, context-aware descriptions. For example, it summarizes a deeply nested conditional before detailing each condition within that context. Implemented as a Visual Studio Code extension, it uses ElevenLabs text-to-speech with two distinct voices: one reads each line verbatim, and the other provides contextual explanations. The approach is designed to improve comprehension for blind and visually impaired programmers. It has not yet been formally evaluated with BVI participants.