AI Based Voice Cloning and Generation for Vocally Challenged

AI Based Voice Cloning and Generation for Vocally Challenged

Mr.Dhanush B, Mr.Dhanush K, Ms.Narmadha M, Mr.Vijay S, Mr.Varshik Daniel L

Department of Artificial Intelligence and Machine Learning

Sri Shakthi Institute of Engineering and Technology

Coimbatore,India

Abstract- Voice cloning, the ability to replicate a person’s voice with high fidelity, has significant applications in entertainment, accessibility, virtual assistants, and forensic sciences. Recent advancements in deep learning have demonstrated the potential of Generative Adversarial Networks (GANs) to generate realistic synthetic audio. This study explores the application of GANs for voice cloning, leveraging their adversarial training mechanism to achieve high-quality and natural-sounding voice synthesis.

        The proposed framework integrates a generator network designed to produce realistic audio waveforms and a discriminator network tasked with distinguishing between real and synthetic samples. The system is trained on a dataset of diverse voice recordings, focusing on capturing both prosody and speaker-specific features. To enhance the cloning process, the model employs auxiliary losses, such as mel-spectrogram reconstruction and perceptual loss, ensuring the generated audio aligns closely with human perception.

        Experimental results demonstrate that GAN-based voice cloning outperforms traditional methods in both audio quality and speaker similarity, even with limited data. The research also discusses ethical considerations, including misuse risks and countermeasures, emphasizing the importance of responsible deployment. The findings establish GANs as a promising approach for advancing voice cloning technology while highlighting avenues for future research in robustness and real-time applications.