Smart Image Captioning with X-Ray Bone Healing Detection

Abstarct-Smart Image Captioning with X-Ray Bone Healing Detection The present work introduces an intelligent system that integrates deep learning-based image captioning with medical X-ray analysis for automated bone fracture and healing detection. The system proposed in this work unifies visual understanding and diagnostic reasoning to produce descriptive captions of the medical images as well as the detection of fracture types, localization of affected areas, and tracking of healing progress. This model leverages convolutional neural networks (CNNs), attention-based captioning models (BLIP), object detection (YOLO), and explainability visualization (Grad-CAM) for an end-to-end interpretation of the X-ray image. The output is optimized with multilingual text-to-speech (TTS) for better accessibility by medical professionals and patients.