Apps that make a difference: Gemini Live assistant
Gemini Live is an artificial intelligence (AI) assistant that can help with everyday tasks by listening, speaking, and using your phone’s camera to understand what is around you. Some people describe it as being like having a helpful friend who can answer questions, read information, and describe things in real time.
This page introduces what Gemini Live can do and how some blind and partially sighted people are using it. It is not a step-by-step guide, and it is not intended to replace support from people or other tools. Instead, it is here to help you understand what’s possible and decide whether it might be something you want to explore with support.
What is Gemini Live?
Gemini Live is available on both Android and iOS devices. It is free to use, although if you have an iPhone you will need a Gmail email address to access it.
You do not need to use technical language or special commands. You can speak to Gemini Live in a natural way, as if you were chatting with another person. You can ask questions, give instructions, or ask for clarification if something is not clear.
Using the camera to read and describe
One of the most useful features of Gemini Live is that it can use your phone’s camera to understand what is in front of you.
You can point your phone at text, such as letters, leaflets, menus or packaging, and Gemini Live can read the text out loud. If it cannot see the text clearly enough, it will usually tell you. You can then ask follow-up questions, for example asking it to repeat a phone number or explain part of what it has read.
For example, some people use Gemini Live when eating out. You might point your phone at a menu and ask it to read the options aloud. You can then ask follow-up questions such as which dishes include chicken, what the vegetarian options are, or to repeat a particular item more slowly. This can help you understand what’s available without having to rely entirely on someone else reading the menu to you.
You can also use Gemini Live to describe your surroundings. For example, you might point your phone towards a room or an object and ask what it can see. Some people use it to identify items such as plants, and then ask further questions, such as how often a plant needs watering.
Asking questions and following up
One of the strengths of Gemini Live is that you can ask questions about what it has just seen or read. This can make it feel more conversational and flexible than some other tools.
For example, after reading a letter, you might ask:
- “Can you say that phone number again?”
- “Is this letter asking me to do anything?”
After identifying an object, you might ask:
- “What is this used for?”
- “Can you read the instructions on this?”
- “What is the use-by date?”
Things to be aware of
Gemini Live is not fully hands-free. Some residual vision is usually needed to find the ‘open Live’ button in the app and to point the camera towards what you want it to see. Because of this, it may not be suitable or comfortable for everyone.
Like all AI tools, it can also make mistakes. It is best used as a support tool rather than something to rely on for important decisions.
Getting support
Gemini Live is one of several tools that can help with reading, identifying objects, and understanding information. It may be useful on its own or alongside other apps and support.
Our Digital Skills Advisors can talk through tools like Gemini Live, help you decide whether it might be useful for you, and support you to explore it safely and at your own pace.
If you would like to find out more or talk about what technology might help in your daily life, please contact us to see what support is available.