language-models

There are 23 repositories under language-models topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
bert deep-learning flax hacktoberfest jax language-model language-models machine-learning model-hub natural-language-processing nlp nlp-library pretrained-models python pytorch pytorch-transformers seq2seq speech-recognition tensorflow transformer
Language:Python 128465
bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom deep-learning distributed-systems language-models large-language-models machine-learning neural-networks pytorch volunteer-computing pipeline-parallelism tensor-parallelism guanaco llama chatbot gpt transformer nlp pretrained-models llama2 falcon
Language:Python 8887
argosopentech / argos-translate
Open-source offline translation library written in Python
language-models linux machine-translation nlp open-source python transformers translation
Language:Python 3423
jalammar / ecco
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
explorables language-models natural-language-processing nlp pytorch visualization
Language:Jupyter Notebook 1939
FARM
deepset-ai / FARM
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
language-models bert nlp deep-learning transfer-learning pytorch nlp-library nlp-framework xlnet-pytorch ner question-answering pretrained-models roberta germanbert
Language:Python 1732
atfortes / Awesome-LLM-Reasoning
Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought, Instruction-Tuning and Multimodality.
awesome chain-of-thought chatgpt cot gpt gpt-4 in-context-learning language-models mllm multimodal papers prompt prompt-engineering question-answering reasoning vllm
1254
zjukg / KG-LLM-Papers
[Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)
awesome awesome-kg awesome-llm awsome-list commonsense gpt knowledge knowledge-graph language-models large-language-models llm nlp paper-list prompt survey
1067
curiousily / Get-Things-Done-with-Prompt-Engineering-and-LangChain
LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.
artificial-intelligence chatgpt deep-learning gpt-4 gpt4 langchain language-models large-language-models llama2 openai prompt-engineering python
Language:Jupyter Notebook 1019
tango
declare-lab / tango
A family of diffusion models for text-to-audio generation.
audio-generation diffusion diffusion-models language-models large-language-models text-to-audio
Language:Python 948
kennethleungty / Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
c-transformers chatgpt cpu cpu-inference deep-learning document-qa faiss langchain language-models large-language-models llama llama-2 llm machine-learning natural-language-processing nlp open-source-llm python sentence-transformers transformers
Language:Python 939
ashishpatel26 / Treasure-of-Transformers
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
transformer python nlp natural-language-processing tensorflow pytorch speech-recognition seq2seq pretrained-models language-models natural-language-generation nlp-library bert natural-language-understanding language-model pytorch-transformers model-hub jax awesome
Language:Jupyter Notebook 865
llm-jp / awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
foundation-models generative-ai generative-model generative-models japanese japanese-language japanese-language-model japanese-llm language-model language-models large-language-model large-language-models llm llm-japanese llms multimodal vision-and-language vision-language vision-language-model
Language:TypeScript 852
zjunlp / Prompt4ReasoningPapers
[ACL 2023] Reasoning with Language Model Prompting: A Survey
arithmetic-reasoning artificial-intelligence awsome-list chain-of-thought chatgpt commonsense-reasoning datasets gpt-3 language-models large-language-models llm logical-reasoning natural-language-processing nlp paper-list prompt prompt-engineering reasoning survey symbolic-reasoning
823
princeton-nlp / LM-BFF
[ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
lm-bff language-models few-shot-learning
Language:Python 710
VinAIResearch / PhoBERT
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
python3 bert bert-embeddings pos-tagging ner nli roberta part-of-speech-tagging named-entity-recognition natural-language-inference language-models vietnamese vietnamese-nlp vncorenlp rdrsegmenter deep-learning transformers transformers-library fairseq phobert
636
monarch-initiative / ontogpt
LLM-based ontological extraction tools, including SPIRES
ai gpt-3 language-models linkml nlp oaklib relation-extraction monarchinitiative chat-gpt large-language-models obofoundry data-modeling information-extraction llm named-entity-recognition ner
Language:Jupyter Notebook 548
HazyResearch / hyena-dna
Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena
foundation-models genomics language-models
Language:Assembly 531
EricFillion / happy-transformer
Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.
language-models artificial-intelligence ai question-answering bert roberta nlp machine-learning text-classification deep-learning transformers python natural-language-processing
Language:Python 513
jeffhj / LM-reasoning
This repository contains a collection of papers and resources on Reasoning in Large Language Models.
large-language-models reasoning deductive-reasoning natural-language-processing artificial-intelligence human-intelligence language-modeling language-models awesome-list chain-of-thought paper-list in-context-learning prompt-learning chatgpt gpt-3 llm prompt-engineering
508
bigscience-workshop / xmtf
Crosslingual Generalization through Multitask Finetuning
instruction-tuning large-language-models multitask-learning language-models bloom multilingual-nlp t5 bloomz mt0 zero-shot-learning
Language:Jupyter Notebook 507
neurocult / agency
🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.
ai chatgpt golang llm agents artificial-general-intelligence artificial-intelligence autonomous-agents generative-ai go gpt language-models llmops machine-learning nlp openai rag vector-database artificial-neural-networks neural-network
Language:Go 404
cedrickchee / chatgpt-universe
ChatGPT Universe is fleeting notes on ChatGPT, GPT, and large language models (LLMs)
chatgpt generative-model resource-list gpt language-models
372
sdadas / polish-nlp-resources
Pre-trained models and language resources for Natural Language Processing in Polish
natural-language-processing polish-language polish word-embedding lexicons machine-learning language-models
315
hooshvare / parsbert
🤗 ParsBERT: Transformer-based Model for Persian Language Understanding
nlp nlu bert parsbert persian-bert persianber persian-language text-classification named-entity-recognition ner transformer sentiment-analysis downstream-tasks language-models
Language:Jupyter Notebook 313
cli99 / llm-analysis
Latency and Memory Analysis of Transformer Models for Training and Inference
analysis deep-learning machine-learning nlp transformers language-model language-models
Language:Python 306
petals-infra / chat.petals.dev
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
api bloom chatbot distributed-systems gpt guanaco language-models large-language-models llama transformer volunteer-computing llama2
Language:Python 301
huggingface / datablations
Scaling Data-Constrained Language Models
gpt high-performance-computing language-models large-language-models llms scaling-laws
Language:Jupyter Notebook 298
extreme-bert / extreme-bert
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
machine-learning natural-language-processing nlp python deep-learning bert language-model language-models pytorch transformer
Language:Python 282
agencyenterprise / PromptInject
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
ai-safety language-models ml-safety agi ai-alignment agi-alignment adversarial-attacks gpt-3 large-language-models machine-learning chain-of-thought prompt-engineering
Language:Python 276
neulab / knn-transformers
PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT
huggingface knn-lm language language-models models nearest nearest-neighbor neighbor neuro-symbolic pytorch retomaton transformers knnlm machine translation knn-mt knnmt knn knn-transformers
Language:Python 265
helallao / perplexity-ai
Unofficial API Wrapper for Perplexity.ai + Account Generator
ai api artificial-intelligence chatgpt gpt language-model language-models perplexity
Language:Python 255
bhattbhavesh91 / voice-assistant-whisper-chatgpt
This repository will guide you to create your own Smart Virtual Assistant like Google Assistant using Open AI's ChatGPT, Whisper. The entire solution is created using Python & Gradio.
chatgpt google-assistant gpt-3 language-model openapi virtual-assistant voice-assistant whisper gradio huggingface language-models chatgpt-api
Language:Jupyter Notebook 236
epfl-dlab / aiflows
🤖🌊 aiFlows: The building blocks of your collaborative AI
agent agents ai ai-framework ai-frameworks chatgpt copilot gpt language-model language-models llm llms open-source oss python
Language:Jupyter Notebook 229
Robofied / Awesome-NLP-Resources
This repository contains landmark research papers in Natural Language Processing that came out in this century.
artificial-intelligence bert language language-models machine-learning natural-language-processing nlp papers vectors
209
p-lambda / dsir
DSIR large-scale data selection framework for language model training
data data-selection language-models data-filtering large-scale importance-resampling
Language:Python 199
Sea-Snell / JAXSeq
Train very large language models in Jax.
gpt2 gpt3 huggingface language-models opt deep-learning flax jax
Language:Python 187

language-models

huggingface / transformers

bigscience-workshop / petals

argosopentech / argos-translate

jalammar / ecco

deepset-ai / FARM

atfortes / Awesome-LLM-Reasoning

zjukg / KG-LLM-Papers

curiousily / Get-Things-Done-with-Prompt-Engineering-and-LangChain

declare-lab / tango

kennethleungty / Llama-2-Open-Source-LLM-CPU-Inference

ashishpatel26 / Treasure-of-Transformers

llm-jp / awesome-japanese-llm

zjunlp / Prompt4ReasoningPapers

princeton-nlp / LM-BFF

VinAIResearch / PhoBERT

monarch-initiative / ontogpt

HazyResearch / hyena-dna

EricFillion / happy-transformer

jeffhj / LM-reasoning

bigscience-workshop / xmtf

neurocult / agency

cedrickchee / chatgpt-universe

sdadas / polish-nlp-resources

hooshvare / parsbert

cli99 / llm-analysis

petals-infra / chat.petals.dev

huggingface / datablations

extreme-bert / extreme-bert

agencyenterprise / PromptInject

neulab / knn-transformers

helallao / perplexity-ai

bhattbhavesh91 / voice-assistant-whisper-chatgpt

epfl-dlab / aiflows

Robofied / Awesome-NLP-Resources

p-lambda / dsir

Sea-Snell / JAXSeq