Zero Day Vulnerability Crawling Dark and Deep Web

Zero Day Vulnerability Crawling Dark and Deep Web

Saanvi Burle, Jay Gadekar, Siddharth Gholap, Prerna Patil

MIT WPU School of Polytechnic and Skill Development, Pune

Abstract— Keeping up with the most recent security flaws is essential in the modern world, as cybersecurity attacks are evolving to become more complex. By keeping an eye on 0-day vulnerability discussion forums, this initiative attempts to assist consumers in staying informed about new security concerns.

The endeavour starts by determining which forums are pertinent and crucial to watch. The project team strives to comprehend each forum's structure once the forums have been discovered. To determine which threads, categories, and sub-threads contain the most pertinent information to extract, this process involves analysis.

The team makes use of two well-liked scraping programmes, Scrapy and BeautifulSoup, to crawl and scrape the forum pages. Using these resources, a web scraper is created that automatically browses forum pages and extracts pertinent data on vulnerabilities.

The scraper gathers information such as the specifics of the vulnerability, the exploit code, and the severity rating.

Subscribers are notified via email through automated alerts when new updates are available. By supplying their email address and the relevant software, individuals can subscribe to the service via MailChimp. The frequency of alerts can be set by users, ranging from instant notifications to daily or weekly digests.

To find new patterns and trends, the gathered data is analysed. Users can utilise this to take action to safeguard their systems and keep up with new security risks. Users can take precautions to defend their systems against a vulnerability, for instance, if the data indicates that a specific kind of vulnerability is increasing in frequency.

The project team periodically checks and changes the scraping tool and alerts to make sure that it is constantly current and gathering the most recent data. Users will benefit from quick and accurate information about new security dangers thanks to this.

The project also contains a simple website with a login/signup page and a subscription area utilising MailChimp in addition to the scraping tool and notifications. Users can quickly sign up for the service and modify their subscription choices using this page.

Overall, this initiative offers customers who want to stay updated on new security dangers a useful service. Users can take proactive measures to secure their systems and stay on top of new threats by keeping an eye on discussion forums for 0-day vulnerabilities and delivering automated alerts.

Keywords— security flaws, cybersecurity attacks, 0-day vulnerability discussion forums, staying informed, pertinent forums, forum structure, analysis, scraping programs, Scrapy, BeautifulSoup, web scraper, vulnerability data, exploit code, severity rating, email notifications, automated alerts, subscribers, MailChimp, frequency of alerts, data analysis, patterns and trends, safeguarding systems, security risks, scraping tool, current data, simple website, login/signup page, subscription area, proactive measures, automated alerts.