End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects

All-in-one UI for merged LLMs in Hugging Face

Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.

Intelligent layer pruning toolkit for LLMs featuring iterative optimization, self-healing algorithms, and comprehensive benchmarking.

A continuous generalist web navigation agent that merges individually fine-tuned LLMs as domain experts.

Mergekit Assistant is a cutting-edge toolkit designed for the seamless merging of pre-trained language models. It supports an array of models, offers various merging methods, and optimizes for low-resource environments with both CPU and GPU compatibility.

Mergekit supports various architectures like Llama, Mistral, and more models, enabling merges on CPU or GPU with low memory needs through lazy tensor loading and out-of-core processing. It handles elaborate operations such as interpolated gradients, frankenmerging (layer-wise), LoRA extraction, and mixture of experts merging.​ [ by Arcee AI ]