Loading article...
Loading article...
Stream/Area:
-
Subject:
-
Paper ID:
IJSREM64853
Volume:
10 |
6 |
Jun 2026
Pages:
1-4
Publication Frequency:
Monthly (12 issues per year)
License:International Journal of Scientific Research in Engineering and Management follows the Creative Commons Attribution 4.0 (CC BY 4.0) License, allowing free use and distribution with proper attribution.
Department of computer science and Engineering
Shivalik college of Engineering
Department of computer science and Engineering
Shivalik college of Engineering
Department of computer science and Engineering
Shivalik college of Engineering
Department of computer science and Engineering
Shivalik college of Engineering
Department of computer science and Engineering
Shivalik college of Engineering
Modern surveillance systems continue to rely heavily on human monitoring, resulting in delayed responses, operator fatigue, and high false positive rates. This paper presents VigileAI, a hybrid Edge-AI surveillance framework designed to provide real-time intrusion detection, crowd analysis, and intelligent threat assessment. The proposed system integrates YOLOv8- based human detection, loitering analysis, crowd monitoring, and a Vision language Model (VLM) powered by Google’s Gemini API. The Edge-AI engine performs rea-time video processing and anomaly detection while the gemini module provides contextual understanding of captured surveillance evidence. Unlike conventional systems that merely detect objects, VigileAi generates detailed scene descriptions, estimates crowd size, identifies suspicious activities, analyze vehicles, and assists operators with natural-language threat summaries. The system utilizes a Python-based computer vision engine, Node.js backend microservices, MongoDB storage, Socket.io communication, and a Next.js dashboard. Experimental evaluation demonstrates high detection accuracy with low latency while significantly improving situational awareness. The proposed framework contributes toward intelligent surveillance by combining object detection and multimodal scene interpretation in a unified architecture.
KEYWORDS
This paper presented VigileAI, an intelligent surveillance framework combining Edge AI and Vision-Language Models for real-time threat assessment. The proposed system successfully integrates YOLOv8-based intrusion detection, crowd analysis, evidence generation, and Gemini-powered scene interpretation into a unified architecture. Experimental results demonstrate that the framework provides accurate detection, low latency, and enhanced contextual awareness. The study highlights the potential of combining computer vision and multimodal reasoning to create next-generation intelligent surveillance systems.
[1] J. Redmon et al., "You Only Look Once: Unified, Real-Time Object Detection," CVPR, 2016. [2] G. Jocher et al., "Ultralytics YOLOv8 Documentation," Ultralytics, 2024. [3] N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," CVPR, 2005. [4] S. Sultani et al., "Real-World Anomaly Detection in Surveillance Videos," CVPR, 2018. [5] A. Radford et al., "Learning Transferable Visual Models From Natural Language Supervision," ICML, 2021. [6] Google DeepMind, "Gemini: A Family of Highly Capable Multimodal Models," 2024. [7] OpenCV Development Team, "OpenCV Documentation," 2024. [8] Pressman, R. S., Software Engineering: A Practitioner's Approach, 2020. [9] Russell, S. and Norvig, P., Artificial Intelligence: A Modern Approach, 2021. [10] Goodfellow, I., Bengio, Y., and Courville, A., Deep Learning, MIT Press, 2016.
Publication Date
6/12/2026
Peer Review Type
Double-Blind Peer Review
Review Rounds: 2
Documents
Article Views
0
Total views since publication
PDF Downloads
4
Total downloads since publication
Geographic Reach
5
Digital Preservation: This article is permanently archived on Zenodo and complies with all data preservation standards across major indexing platforms.
Plagiarism Screening
This manuscript has been checked for plagiarism using TurnitinPlagiarismChecker software.
Conflict of Interest
The authors declare no conflict of interest related to this research work.
Funding Information
No funding information available for this research.
Related research in the same subject area
Loading similar articles...