faseehahmed26

NLP-progress

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

fastapi

FastAPI Tutorials & Deployment Methods to Cloud and on-prem infrastructures

FLAN

phasellm

Large language model evaluation and workflow framework from Phase AI.

petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

text-generation-inference

Large Language Model Text Generation Inference

data-science-on-aws

AI and Machine Learning with Kubeflow, Amazon EKS, and SageMaker

vertex-ai-mlops

Google Cloud Platform Vertex AI end-to-end workflows for machine learning operations

transpeeder

train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism

llama-tune

LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers

LLM-Pretrain-FineTune

Deepspeed、LLM、Medical_Dialogue、医疗大模型、预训练、微调

intel-extension-for-deepspeed

Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note XPU is already supported by stock DeepSpeed.

finetune-gpt2xl

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Chatglm_lora_multi-gpu

chatglm多gpu用deepspeed和

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

DeepSpeedExamples

Example models using DeepSpeed

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

ChatGPT-Like-Bot-On-Google-Collab

One Click Run ChatGPT like Bot

core

The stable core is your personal server for AI rendering, powered with community plugins

galai

Model API for GALACTICA

ChatRWKV

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

gptq

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

dalai

The simplest way to run LLaMA on your local machine

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

CheatSheet-LLM

The LLM (Language Model) Cheatsheet is a quick reference guide that provides an overview of the key concepts and techniques related to natural language processing (NLP) and language modeling. It is designed to be a helpful tool for both beginners and advanced practitioners in the field of NLP.

stable-diffusion-webui

Stable Diffusion web UI