SecretScraper

SecretScraper is a configurable web scraping tool designed to extract sensitive information from target websites using customizable regular expressions. Its primary use case is for security assessments and vulnerability testing, featuring a robust web crawler that can handle multiple targets, support domain whitelisting and blacklisting, and enable seamless configurations through YAML files. Notable features include built-in rate limiting, an HTTP connection pool management, and flexibility in handling headers, proxies, and cookies.