Audio Enabled Object Detection System with NLP based Interaction

Audio Enabled Object Detection System with NLP based Interaction

Aishwarya Pralhad Chakrapani1, Aryan Mayur Dhuru2, Shraawani Prakash Lattoo3,
Parth Samir Dalvi4, Rohit Sanjay Shahane5, Prof. Poonam Sunil Jadhavar6

1,2,3,4,5 Department of Computer Engineering, Padmabhooshan Vasantdada Patil Institute of Technology, Pune

---------------------------------------------------------------------***---------------------------------------------------------------------

ABSTRACT - The project aims to develop an innovative object detection system that uses audio input and output to enhance user engagement and provide detailed product information. The system employs deep learning techniques for real-time object identification, generating an audio-based output with the object's name. In order to enable users to interact with the system verbally, it also incorporates Natural Language Processing (NLP), which interprets and processes speech in order to identify the object. The system also includes an online search module, which provides users with descriptions of the object's attributes and potential applications. The system undergoes rigorous testing and optimization to ensure accuracy and responsiveness.

The project employs user-friendly technology that can assist people with low vision or disabilities, providing a practical and time-saving alternative for seeking instant information about objects. In order to make object recognition and information retrieval a smooth and inclusive experience for all users, this audio-enabled system is a first step towards bridging the gap between artificial intelligence and human-technology interaction.

Key Words: Object Detection, Natural Language Processing, YOLOv4, Google Gemini, MeaningCloud, Wikipedia library