gau

getallurls (gau) is a tool designed to retrieve known URLs related to a specific domain from sources such as AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl. Its primary use case is for cybersecurity professionals and researchers to gather a comprehensive list of URLs for further analysis, with notable features including filtering by HTTP status codes, MIME types, and the ability to include or exclude specific file extensions. Additionally, gau supports multi-threading for enhanced performance and outputs results in various formats, including JSON.