urx

Urx is a command-line tool that efficiently extracts URLs from OSINT archives like the Wayback Machine and Common Crawl, utilizing asynchronous processing for rapid data collection. Key features include keyless access to multiple sources, result filtering by various criteria, URL normalization, and support for multiple output formats, making it ideal for security testing and analysis applications. Additionally, it supports caching and incremental scanning to enhance performance and efficiency in URL collection tasks.