A MULTIMODAL CONVERSATIONAL AI SYSTEM FOR INTELLIGENT REAL-TIME ANDROID INTERACTION

The Voice Agent project successfully demonstrates how modern conversational AI can really change the way people interact with computers using natural voice communication. This project was built using free and open-source tools like Python LiveKit Agents SDK and Google Gemini 2.5 Flash Native Audio. The Voice Agent system can understand what people say do things with seven tools like checking the weather, searching the web, sending emails and using the camera. It can even talk back to people in a way and change its tone based on how they behave. The Voice Agent project also works on Android mobile devices using LiveKit WebRTC, which means that people can use it on their computers and phones without spending any money. The Voice Agent is an example of how a smart AI voice assistant can be built for free and work on many different platforms. This project can be improved in the future to work offline connect with devices and use voice recognition to identify people. The Voice Agent project is a starting point, for making even better AI voice assistants in the future.

[1]     S. V. Doshi, S. B. Pawar, A. G. Shelar, and S. S. Kulkarni, “Artificial Intelligence Chatbot in Android System using Open-Source Program-O,” International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), vol. 6, no. 4, Apr. 2017.   [2]       P. G., et al., “Voice Assistant using Artificial Intelligence,” International Journal of Engineering Research & Technology (IJERT), vol. 11, no. 05, May 2022.   [3]    K. Yasodha, et al., “AI Voice Assistant Android App using Keyword Matching and NLP,” International Journal of Computer Techniques (IJCT), vol. 12, no. 4, Jul.–Aug. 2025.   [4]   F. J. Kiwa, et al., “AI Voice Assistant for Smartphones with NLP Techniques,” in IEEE 2nd Zimbabwe Conference on Information and Communication Technology (ZCICT), 2023.   [5]   C. González-Mora, et al., “Augmenting Websites with Voice Commands: An Approach Focused on Accessibility,” Journal of Web Engineering, vol. 24, 2025.   [6]     “Desktop Assistant AI Using Python,” International Research Journal of Engineering and Technology (IRJET), 2020.   [7]    P. Shende, et al., “AI Based Voice Assistant Using Python,” International Journal of Computer Applications, 2020.   [8]      R. Geetha, et al., “The Voice Enabled Personal Assistant for PC Using Python,” International Journal of Engineering Research & Technology (IJERT), 2021.   [9]     S. Kulhalli, et al., “Personal Assistant with Voice Recognition Intelligence (PARI),” International Journal of Innovative Research in Computer and Communication Engineering, 2020.   [10]    “Desktop Assistant AI Using Python,” International Research Journal of Engineering and Technology (IRJET), 2020.