An Android Based Object Detection and Voice Assistance App for Visually Impaired User

Visually impaired individuals often face daily challenges in recognizing objects and reading text in their surroundings, limiting their independence and quality of life. With the rapid development of mobile technology and artificial intelligence, smartphones can now serve as powerful assistive tools. This project presents an Android-based mobile application designed specifically for visually impaired users, which integrates real-time object detection and text recognition functionalities. The application utilizes the smartphone’s camera to capture live images from the user’s environment. Through object detection algorithms powered by machine learning models such as TensorFlow Lite or YOLO, the app identifies commonly encountered objects (e.g., furniture, people, and everyday items). Simultaneously, the app incorporates Optical Character Recognition (OCR) technology, using Google’s ML Kit, to extract and read aloud printed or handwritten text from books, labels, and signs. To ensure ease of use, the application features a voice-guided interface and employs Text-to-Speech (TTS) to deliver audio feedback, enabling users to interact with the app without needing to look at the screen. The interface is further optimized for accessibility with large buttons, simple navigation, and compatibility with Android’s Talk Back services.