> cat /dev/github | grep security-tools
discovered 03 Aug 2026

clean-text

via awesome-list
→ View on GitHub
`clean-text` is a Python package designed to preprocess and normalize user-generated content from web and social media sources, transforming corrupted input into clean text representations. It incorporates libraries like `ftfy` and `unidecode`, along with custom RegEx rules, allowing for extensive options such as fixing Unicode errors, transliterating to ASCII, and filtering out various elements like URLs and emails. The tool offers customizable parameters, making it adaptable for diverse textual cleaning tasks.