scrapy-kafka-export

The `scrapy-kafka-export` package is a Scrapy extension designed to facilitate the export of scraped items directly to Apache Kafka topics. It supports SSL-based authentication for secure connections and provides configuration options for batch size, broker specifications, and topic naming, making it suitable for scalable data pipelines that need to move collected data efficiently. Key features include support for message keys based on item IDs and the ability to customize SSL configurations for secure Kafka communication.