Digitous's repositories
LLM-SLERP-Merge
Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
ModelREVOLVER
Model REVOLVER, a human in the loop model mixing system.
GPTQ-for-GPT-NeoX
4 bits quantization of LLaMa using GPTQ [Project to add GPT-NeoX and Pythia quant and inference]
StratusScope
LayerScope is a language model tool that loads two language models of the same architecture and parameter size and generates a bar graph detailing which layers have the most difference between the models.
Enhanced-LM-Mixer
This is a modified language model weight-sum merge script based off of LostRuin's work. Enhancements include migrating copies of necessary files to run the model to the new model folder as well as enhanced console output.
Easy-LLM-PEFT-GUI
Fuses Language Model Adapters [LoRA, QLoRA, etc] to any chosen base model with three popups for model, peft, save location.
LM_Transformers_BlockMerge
Image Diffusion block merging technique applied to transformers based Language Models.