Updated 9 months ago

mergekit • Science 44%

Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.