language-model

There are 41 repositories under language-model topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
nlp natural-language-processing pytorch language-model tensorflow bert language-models pytorch-transformers nlp-library transformer model-hub pretrained-models jax flax seq2seq speech-recognition hacktoberfest python machine-learning deep-learning
Language:Python 86741
LAION-AI / Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
chatgpt language-model rlhf ai assistant discord-bot machine-learning nextjs python
Language:Python 19435
tatsu-lab / stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
deep-learning instruction-following language-model
Language:Python 12529
brightmart / nlp_chinese_corpus
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
chinese-dataset chinese-corpus pretrain word2vec nlp bert language-model wiki news question-answering chinese corpus chinese-nlp dataset text-classification
7796
haystack
deepset-ai / haystack
:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-3 and alike). Haystack offers production-ready tools to quickly build ChatGPT-like question answering, semantic search, text generation, and more.
nlp question-answering bert transfer-learning language-model pytorch semantic-search squad elasticsearch information-retrieval summarization transformers natural-language-processing machine-learning ai python chatgpt gpt-3 large-language-models generative-ai
Language:Python 7478
EleutherAI / gpt-neo
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
language-model transformers gpt gpt-2 gpt-3
Language:Python 7401
tokenizers
huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
nlp natural-language-processing natural-language-understanding language-model transformers bert gpt
Language:Rust 6601
NVIDIA / NeMo
NeMo: a toolkit for conversational AI
deep-learning speech-recognition nlp nlp-machine-learning neural-network machine-translation speech-synthesis speech-to-text text-to-speech nmt language-model speaker-diarization speaker-recognition text-normalization asr tts
Language:Python 5965
speechbrain / speechbrain
A PyTorch-based Speech Toolkit
speech-recognition speech-toolkit speaker-recognition speech-to-text speech-enhancement speech-separation audio audio-processing speech-processing speechrecognition asr voice-recognition spoken-language-understanding speaker-diarization speaker-verification pytorch huggingface transformers language-model deep-learning
Language:Python 5502
codertimo / BERT-pytorch
Google AI 2018 BERT pytorch implementation
bert transformer pytorch nlp language-model
Language:Python 5389
EleutherAI / gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
deepspeed-library gpt-3 transformers language-model
Language:Python 4356
mlfoundations / open_clip
An open source implementation of CLIP.
deep-learning pytorch computer-vision language-model multi-modal-learning contrastive-loss zero-shot-classification pretrained-models
Language:Python 3787
BlinkDL / ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
chatbot chatgpt language-model pytorch rnn rwkv
Language:Python 3654
CLUEbenchmark / CLUE
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
nlu benchmark chinese corpus dataset bert albert chineseglue glue roberta language-model pretrained-models transformers tensorflow pytorch
Language:Python 3107
tensorflow / lingvo
Lingvo
speech-recognition translation speech-to-text machine-translation mnist seq2seq language-model tts asr lm nlp tensorflow speech research distributed gpu-computing speech-synthesis
Language:Python 2697
BlinkDL / RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
attention-mechanism deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn transformer transformers rwkv chatgpt
Language:Python 2662
zzw922cn / awesome-speech-recognition-speech-synthesis-papers
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
automatic-speech-recognition papers roadmap rnn cnn dnn attention-mechanism seq2seq acoustic-model timit-dataset tts language-model speaker-verification speech-recognition speech-synthesis neural-network recognition-synthesis diffusion-models singing-voice-synthesis voice-conversion
2509
CyberZHG / keras-bert
Implementation of BERT that could load official pre-trained models for feature extraction and prediction
keras bert language-model
Language:Python 2399
Separius / awesome-sentence-embedding
A curated list of pretrained sentence and word embedding models
wordembedding word-embeddings sentence-embeddings nlp pretrained-embedding awesome-list pretrained-models unsupervised-learning sentence-representations contextualized-representation awesome natural-language subword-models embedding-models cross-lingual bert pretrained-language-model language-model
Language:Python 2110
chiphuyen / lazynlp
Library to scrape and clean web pages to create massive datasets.
artificial-intelligence natural-language-processing nlp text-mining language-model python open data-science
Language:Python 2099
salesforce / awd-lstm-lm
LSTM and QRNN Language Model Toolkit for PyTorch
lstm pytorch language-model sgd qrnn
Language:Python 1900
ai-forever / ru-gpts
Russian GPT3 models.
deep-learning gpt3 language-model russian russian-language transformers
Language:Python 1741
pytorch-cpp
prabhuomkar / pytorch-cpp
C++ Implementation of PyTorch Tutorials for Everyone
cplusplus artificial-intelligence machine-learning pytorch torch tensors neural-network autograd libtorch recurrent-neural-network tutorial generative-adversarial-network convolutional-neural-network language-model interactive-tutorials colab datasets scriptmodule-files
Language:C++ 1547
NVIDIA / OpenSeq2Seq
Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP
neural-machine-translation multi-gpu deep-learning sequence-to-sequence seq2seq multi-node speech-recognition speech-to-text mixed-precision float16 speech-synthesis text-to-speech language-model tensorflow
Language:Python 1495
microsoft / DeBERTa
The implementation of DeBERTa
bert deeplearning representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder
Language:Python 1453
huggingface / pytorch-openai-transformer-lm
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
neural-networks pytorch openai language-model transformer
Language:Python 1433
spago
nlpodyssey / spago
Self-contained Machine Learning and Natural Language Processing library in Go
deep-learning machine-learning natural-language-processing neural-network computation-graph automatic-differentiation artificial-intelligence deeplearning transformer-architecture recurrent-networks lstm language-model question-answering bert bert-as-service nlp automatic-translation bart named-entities-recognition
Language:Go 1339
ymcui / Chinese-ELECTRA
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
nlp bert electra pre-trained-model chinese chinese-electra language-model pytorch tensorflow
Language:Python 1251
microsoft / LMOps
General technology for enabling AI capabilities w/ LLMs and MLLMs
nlp agi gpt llm lm pretraining prompt lmops promptist x-prompt language-model
Language:Python 1244
explosion / spacy-transformers
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
spacy spacy-pipeline spacy-extension nlp natural-language-processing natural-language-understanding pytorch bert google pytorch-model openai language-model machine-learning huggingface transfer-learning xlnet gpt-2
Language:Python 1219
microsoft / LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
gpt-2 adaptation language-model gpt-3 low-rank pytorch deep-learning roberta deberta
Language:Python 1143
mihail911 / nlp-library
curated collection of papers for the nlp practitioner 📖👩‍🔬
neural-network dialogue nlp machine-learning neural-machine-translation deep-learning language-model nlp-datasets
1067
KoBERT
SKTBrain / KoBERT
Korean BERT pre-trained cased (KoBERT)
korean-nlp language-model bert nlp pytorch transformers
Language:Jupyter Notebook 1060
bupticybee / ChineseAiDungeonChatGPT
中文版的ai地牢，直接使用的openai的ChatGPT api作为讲故事的模型。
ai aidungeon chatgpt gpt-3 language language-model
Language:Python 1020
JonasGeiping / cramming
Cramming the training of a (BERT-type) language model into limited compute.
english-language language-model machine-learning
Language:Python 994
brightmart / bert_language_understanding
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning nlp question-answering textcnn fasttext
Language:Python 956