IoT Enabled Vision-Guided Robotic Arm System for Automated Color-Based Object Segregation

The proposed Vision-Guided Intelligent Robotic Arm System successfully demonstrates the integration of Computer Vision, IoT, and embedded automation technologies for automated color-based object segregation. The system utilizes OpenCV-based image processing, MQTT cloud communication, and ESP32-based robotic control to perform efficient real-time pick-and-place operations. The implementation of HSV color detection and cloud-integrated communication improves sorting accuracy, operational reliability, and real-time monitoring capabilities. The lightweight PVC structure and low-cost hardware components make the system suitable for educational, research, and small-scale industrial applications. The developed framework provides a scalable, cost-effective, and intelligent automation solution for Industry 4.0 environments. The proposed system can be further enhanced using Artificial Intelligence and advanced object recognition techniques for future smart manufacturing and robotic automation applications. The proposed system provides a scalable and cost-effective solution for next-generation smart industrial automation applications.

[1] G. Bradski and A. Kaehler, Learning OpenCV: Computer Vision with the OpenCV Library, O’Reilly Media, 2018. [2] S. K. Lakshmanan and R. Kumar, “Real-Time Color Object Detection and Sorting using OpenCV and Arduino,” IEEE International Conference on Robotics and Automation (ICRA), pp. 210–215, 2019. [3] A. Gupta and R. Bansal, “Performance Analysis of MQTT and HTTP Protocols for IoT Applications,” IEEE International Conference on Computing and Communication, pp. 102–108, 2020. [4] P. Chinchansure and A. Kulkarni, “Design and Implementation of Color Sensing Industrial Robot using IoT,” International Research Journal of Engineering and Technology (IRJET), vol. 7, no. 6, pp. 245–250, 2020. [5] V. Sharma and N. Gupta, “Vision-Based Robotic Arm for Automated Sorting in Small Scale Industries,” International Journal of Engineering Research (IJER), vol. 9, no. 4, pp. 1120–1126, 2020. [6] M. T. H. Khan and A. S. M. Bakar, “A Smart Sorting Robot based on Color Sensing and IoT Monitoring,” International Journal of Advanced Science and Technology, vol. 29, no. 5, pp. 440–448, 2020. [7] S. S. Patil and M. S. Gaikwad, “IoT Based Industrial Automation and Monitoring System,” International Journal of Scientific Research in Engineering and Management (IJSREM), vol. 5, no. 7, pp. 12–18, 2021. [8] D. R. Patil and S. M. Kherde, “Color-Based Object Segregation Using Machine Vision and Robotic Arm,” International Journal of Scientific Research in Science and Technology, vol. 8, no. 3, pp. 156–162, 2021. [9] S. L. Varma and K. R. Reddy, “Low-Cost Industrial Automation using ESP32 and MQTT via HiveMQ Broker,” IEEE Global Conference on Wireless Computing and Networking, pp. 301–307, 2021. [10] T. S. Kumar and B. M. Rao, “Automatic Object Sorting System using Python and Embedded Controllers,” Journal of Robotics and Control, vol. 3, no. 2, pp. 88–95, 2022. [11] Espressif Systems, ESP32 Technical Reference Manual, Version 4.6, 2023. [12] A. S. Akinyemi and O. K. Boyinbode, “Development of a Vision-Guided Robot for Industrial Applications,” International Journal of Computer Theory and Engineering, vol. 15, no. 2, pp. 54–59, 2023. [13] K. S. Shaji and A. R. Jose, “MQTT Based Remote Control of Robotic Manipulators,” IEEE International Conference on Inventive Research in Computing Applications (ICIRCA), pp. 455–460, 2024. [14] J. Redmon and A. Farhadi, “YOLO-Based Object Detection for Intelligent Robotic Applications,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7263–7271, 2024.