Mousaic's repositories
bert4torch
参考bert4keras的pytorch实现
bitsandbytes
8-bit CUDA functions for PyTorch
ChatGLM-Tuning
一种平价的chatgpt实现方案, 基于ChatGLM-6B
Chinese-Vicuna
Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca
ColBERT
ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22)
DeepPavlov
An open source library for deep learning end-to-end dialog systems and chatbots.
DeepUnderstandingOfDeepLearning
Python code accompanying the course "A deep understanding of deep learning (with Python intro)"
donut
Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022
embedchain
Framework to easily create LLM powered bots over any dataset.
Get-Things-Done-with-Prompt-Engineering-and-LangChain
LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.
guidance
A guidance language for controlling large language models.
hydra
Hydra is a framework for elegantly configuring complex applications
Large-Language-Model-Notebooks-Course
Practical course about Large Language Models.
lightning-hydra-template
PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡
llama2_sft_dpo_test
llama2_sft_dpo_test
LLMs-from-scratch
Implementing a ChatGPT-like LLM from scratch, step by step
LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
memorpy
Python library using ctypes to search/edit windows / linux / macOS / SunOS programs memory
minChatGPT
A minimum example of aligning language models with RLHF similar to ChatGPT
mmocr
OpenMMLab Text Detection, Recognition and Understanding Toolbox
MOSS
An open-source tool-augmented conversational language model from Fudan University
NLP-LLM-Fine-tuning-Llame-2-QLoRA-2024
Natural Language Processing (NLP) and Large Language Models (LLM) with Fine-Tuning LLM QLoRA and Llama 2 in 2024
peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
python-mastery
Advanced Python Mastery (course by @dabeaz)
pytorch-transformers-template
This is a template for fast prototype relying on transformers, hydra, fairscale and deepspeed, etc.
qlora_with_trainer
easy to go
sentence-transformers
Multilingual Sentence & Image Embeddings with BERT
stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
trl
Train transformer language models with reinforcement learning.