Updated 9 months ago
mergekit
Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.
Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.