metawarc

Metawarc is a command-line tool designed for efficient extraction of metadata from files contained within WARC (Web ARChive) archives. Its primary use case involves the analysis and retrieval of metadata from various file formats such as PDFs, MS Office documents, and images, while offering features like built-in WARC support, a low memory footprint, and comprehensive command options for indexing, statistics, and metadata dumping. Notably, it generates a DuckDB database for organized metadata storage and provides easy CLI commands for various extraction tasks.