SuperXiang

DeepSeek-MoE

Active-IT

Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"

AgentLite

alphageometry

AppAgent

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

babilong

BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.

Cherry_LLM

[NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other models

deep-language-networks

We view Large Language Models as stochastic language layers in a network, where the learnable parameters are the natural language prompts at each layer. We stack two such layers, feeding the output of one layer to the next. We call the stacked architecture a Deep Language Network - DLN

devika

Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. Devika aims to be a competitive open-source alternative to Devin by Cognition AI.

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

dsir

DSIR large-scale data selection framework for language model training

faiss_tips

Some useful tips for faiss

leetcode-hard-gym

A hard gym for programming

Linly

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集

List-of-Dirty-Naughty-Obscene-and-Otherwise-Bad-Words

List of Dirty, Naughty, Obscene, and Otherwise Bad Words

LLM-Shearing

Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

LLMTest_NeedleInAHaystack

Doing simple retrieval from LLM models at various context lengths to measure accuracy

milvus

A cloud-native vector database, storage for next generation AI applications

MoDS

ollama

Get up and running with Llama 2, Mistral, and other large language models.

opro

official code for "Large Language Models as Optimizers"

PentestGPT

A GPT-empowered penetration testing tool

PiSSA

reflexion

[NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning

scaling_laws_data_filtering

sentence-transformers

Multilingual Sentence & Image Embeddings with BERT

small-LMs-Task-Planning

Can only LLMs do Reasoning?: Potential of Small Language Models in Task Planning

SupContrast

PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)

Superfiltering

transformer-debugger