Updated 6 months ago
https://github.com/bminixhofer/tokenkit
A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.