Nealcly

llama3

The official Meta Llama 3 GitHub site

DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself

transformer-debugger

weak-to-strong

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

OpenMoE

A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

llm-reasoners

A library for advanced large language model reasoning

awesome-mixture-of-experts

A collection of AWESOME things about mixture-of-experts

llama-moe

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

sort-google-scholar

Sorting Google Scholar search results based on the number of citations

representation-engineering

Representation Engineering: A Top-Down Approach to AI Transparency

vec2text

utilities for decoding deep representations (like sentence embeddings) back to text

HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

Selective_Context

Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.

speculative-decoding

Explorations into some recent techniques surrounding speculative decoding

BotChat

Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.

world-model-for-language-model

TruthX

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"

CLEX

[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models

ICD

Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"

GSM-Plus

GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.

drpo

Dateset Reset Policy Optimization

ALCUNA

[EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge

CaRing

Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs

MORE

Code for paper - On Diversified Preferences of Large Language Model Alignment

TACS

Source code for Truth-Aware Context Selection: Mitigating the Hallucinations of Large Language Models Being Misled by Untruthful Contexts

Werewolf

CoEval

A collaborative LLM-human evaluation pipeline COEVAL.

FewShotCalibration