MidiTok

MidiTok is a Python package designed for tokenizing MIDI and abc music files, facilitating their conversion into sequences of tokens suitable for machine learning models such as Transformers. Notable features include support for various music tokenization methods, training capabilities with Byte Pair Encoding (BPE), Unigram, and WordPiece, as well as integration with Hugging Face for model sharing and collaboration. The tool also provides data augmentation methods and high-performance encoding backed by Hugging Face's tokenizers library.