Google offers real-time vision assistance to blind users on Android – Unite.AI

Google launched Guided Vision in Gemini Live on October 1, 2026, a real-time, voice-guided vision assistance feature created for people who are blind, have low vision, or want intuitive vision assistance. It is now available on Android devices running Android 9 and later in regions and languages ​​where Gemini Live is supported.

Google first previewed the feature on September 1, 2026, in its September Android Drop, where Guided Vision was listed as coming soon on phones running Android 9 and later in countries where Gemini is available. The preview featured the same descriptions of camera sharing and voice feedback for the revamp, and contained a footnote warning that the feature can make errors and is not intended as a medical device, mobility aid, or substitute for safe travel guides, nor for navigation or obstacle detection.

How guided vision works

During a Gemini Live session, the user shares their phone’s camera and Gemini provides spoken descriptions of their surroundings, answers detailed follow-up questions, and provides proactive verbal cues to zero in on what the user wants to explore. If the camera is pointed too high, too close, or slightly to the side, Gemini responds with natural verbal cues to reframe, asking the user to slowly pan right, tilt down, or step back until it has the clear visual context it needs to respond to.

The announcement, written by Isha Sheth, Senior Product Manager for Gemini Live, describes Guided Vision as transforming Gemini into a conversational visual partner that fits into your daily routine with minimal friction.

Developed with Aira and the accessibility community

Google said Guided Vision was developed through close collaboration with the accessibility community. To train Gemini Live for real-world conversational context, the company partnered with Aira to visually interpret data for a total of tens of thousands of hours. Over 1,000 members of Aira’s Trusted Tester network helped stress test and refine the model in their daily routines, while Aira specialists worked directly with Google teams as subject matter experts to establish and evaluate security guardrails.

Sally Khoo, deputy director (Innovation) at SG Enable, said in the announcement: “Because standard phones are typically made for sighted users who can see the screen, a product like Gemini Live’s real-time visual descriptions with the camera’s proactive verbal guidance can help fill a critical gap in everyday tasks at home, from reading the fine print to locating daily essentials.”

According to Google, the feature reflects extensive testing and feedback from blind and low vision communities in India, Brazil, Singapore, Indonesia, Japan and others, gathered to make descriptions, rewording cues and responses natural and useful.

Prashant Verma of the National Association of the Blind, India, said in the same announcement: “Testing these features directly with blind and visually impaired users in Indian languages ​​ensures that this technology offers practical and reliable assistance in everyday life.”

Documented daily use cases

Google has described everyday tasks where quick visual verification is most important. To read fine print and complex text, the company listed small nutrition labels on food packages, dials on appliances and washing machine cycles, and printed menus in dimly lit restaurants. To find and locate objects, he gave the examples of an earphone dropped on the floor and black pepper inside a crowded spice cabinet. To describe items and matching details, users can ask about colors, patterns, and shapes, such as seeing if a striped shirt matches a pair of pants or identifying the color of a specific jacket. To explore your surroundings, Guided Vision returns descriptive overviews of unfamiliar spaces, room layouts, or objects placed on a table.

Google said that Guided Vision supports conversations in multiple languages, and that, like many accessibility innovations, it also provides practical visual assistance for older adults, people with low literacy levels, or anyone trying to read fine print in low-light conditions.

Access paths, availability and declared limitations

Users can reach the feature via the Gemini app, an Android accessibility shortcut, or Google TalkBack. In the Gemini mobile app, users open their profile settings and turn on “Use Guided View in Live,” then open Gemini Live and tap to share the camera. In Android Settings, under Accessibility and then under Vision Assistance, users can set up an Accessibility shortcut to launch Guided Vision using the floating accessibility button, a two-finger swipe gesture, or by pressing both volume keys. Users using Google TalkBack can display the TalkBack menu with a three-finger tap and directly select Guided View.

Google says Guided Vision is a helper utility and can make mistakes. The feature is not a medical device, mobility aid, or white cane replacement and is not intended for navigation, safe travel guidance, or obstacle detection. Users should continue to rely on established mobility aids and safe travel practices in physical environments.

To get started, Google recommends updating the Gemini app and Android system software to the latest versions.