Seeing AI 5.3

Seeing AI is a free application that provides a narration of the user's environment. Developed in collaboration with the visually impaired and low vision community, this ongoing research project leverages the power of artificial intelligence to describe people, text, and objects in the vicinity.

Seeing AI offers a range of tools to support various daily activities:

• Short Text: Immediately vocalizes any text appearing in front of the camera.
• Documents: Provides audio instructions for capturing printed pages, and recognizes the text along with its original formatting.
• Products: Scans barcodes while providing audio guidance through beeps, enabling users to hear the name and packaging information (when available).
• People: Saves faces for recognition purposes and provides an estimate of age, gender, and expression.
• Currency: Recognizes different currency notes.
• Scenes: Describes the overall scene captured by the camera. Users can explore the photo by moving their finger across the screen to hear the location of different objects.
• World: Offers an Audio Augmented Reality experience, allowing users to explore unfamiliar environments. This feature announces objects in your surroundings using Spatial Audio (requires a device with LiDAR and iOS 14+).
• Indoor Navigation: Available on the World Channel, this feature facilitates route creation through buildings (e.g., "entrance to classroom") and navigation by following audio cues (requires a device with an A9 or later processor and iOS 14+).
• Colors: Identifies colors.
• Handwriting: Reads handwritten text, such as greeting cards (available in select languages).
• Light: Generates an audible tone corresponding to the brightness of the surroundings.
• Images in other apps: With a simple tap on "Share" and "Recognize with Seeing AI," users can obtain descriptions of images from applications like Mail, Photos, and Twitter, among others.
• Browse Photos: Provides audio descriptions of photos saved on the user's device.

Seeing AI continues to innovate based on feedback from the community and advancements in AI research.

For tutorials, please check this YouTube playlist: http://aka.ms/SeeingAIPlaylist.

If you have any questions, feedback, or feature requests, please email us at [email protected].