language-modeling

There are 13 repositories under language-modeling topic.

quark0 / darts
Differentiable architecture search for convolutional and recurrent networks
automl convolutional-networks deep-learning image-classification language-modeling neural-architecture-search pytorch recurrent-networks
Language:Python 3707
RL4LMs
allenai / RL4LMs
A modular RL library to fine-tune language models to human preferences
language-modeling nlp reinforcement-learning dialogue-generation machine-translation natural-language-processing summarization table-to-text text-generation
Language:Python 1196
uber-research / PPLM
Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
deep-learning language-modeling machine-learning natural-language-generation natural-language-processing nlp
Language:Python 1031
pemistahl / lingua-go
The most accurate natural language detection library for Go, suitable for long and short text alike
natural-language-processing language-detection language-recognition language-classification language-identification language-processing nlp nlp-machine-learning golang-library go language-modeling text-processing
Language:Go 862
Separius / BERT-keras
Keras implementation of BERT with pre-trained weights
keras language-modeling nlp pretrained-models tensorflow theano transfer-learning transformer
Language:Python 823
meta-toolkit / meta
A Modern C++ Data Sciences Toolkit
nlp nlp-parsing search-engine inverted-index pos-tag text-analysis text-analytics text-classification language-modeling graph-algorithms c-plus-plus word-embeddings
Language:C++ 660
hirofumi0810 / neural_sp
End-to-end ASR/LM implementation with PyTorch
pytorch speech-recognition automatic-speech-recognition asr ctc attention-mechanism attention seq2seq sequence-to-sequence speech language-model transformer language-modeling rnn-transducer transformer-xl streaming
Language:Python 574
songlab-cal / tape
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology.
deep-learning protein-sequences protein-structure semi-supervised-learning benchmark language-modeling dataset pytorch
Language:Python 536
yxuansu / SimCTG
[NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
textgeneration contrastive-learning nlp languagemodel decode language-modeling deeplearning
Language:Python 388
majumderb / rezero
Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
pytroch transformer resnet language-modeling deep-neural-networks
Language:Python 376
L0SG / relational-rnn-pytorch
An implementation of DeepMind's Relational Recurrent Neural Networks (NeurIPS 2018) in PyTorch.
pytorch language-model word-language-model language-modeling deep-learning recurrent-neural-networks deepmind transformer self-attention
Language:Python 243
jeffhj / LM-reasoning
This repository contains a collection of papers and resources on Reasoning in Large Language Models.
large-language-models reasoning deductive-reasoning natural-language-processing artificial-intelligence human-intelligence language-modeling language-models awesome-list chain-of-thought paper-list in-context-learning prompt-learning chatgpt gpt-3 llm prompt-engineering
201
madaan / memprompt
A method to fix GPT-3 after deployment with user feedback, without re-training.
language-generation prompt-tuning language-modeling gpt-3 gpt-3-prompt feedback few-shot-learning user-feedback
Language:Python 194
rusiaaman / XLnet-gen
XLNet for generating language.
xlnet text language-model language-modeling language-generation gpt2 transformer-xl
Language:Python 170
somosnlp / nlp-de-cero-a-cien
Curso práctico: NLP de cero a cien 🤗
nlp natural-language-processing espanol transformers transfer-learning language-modeling word-embeddings rnn lstm attention-mechanism
Language:Jupyter Notebook 156
tonybeltramelli / Deep-Lyrics
Lyrics Generator aka Character-level Language Modeling with Multi-layer LSTM Recurrent Neural Network
deep-learning recurrent-neural-networks tensorflow natural-language-processing language-modeling
Language:Python 139
suriyadeepan / rnn-from-scratch
Use tensorflow's tf.scan to build vanilla, GRU and LSTM RNNs
tensorflow rnn recurrent-neural-networks language-modeling
Language:Python 129
songlab-cal / tape-neurips2019
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology. (DEPRECATED)
deep-learning protein-sequences protein-structure semi-supervised-learning benchmark language-modeling dataset
Language:Python 117
Sunnydreamrain / IndRNN_pytorch
Independently Recurrent Neural Networks (IndRNN) implemented in pytorch.
indrnn rnn action skeleton language-modeling
Language:Python 115
jiali-ms / JLM
A fast LSTM Language Model for large vocabulary language like Japanese and Chinese
tensorflow language-modeling lstm decoder deep-neural-networks beam-search viterbi
Language:Python 109
uzaymacar / comparatively-finetuning-bert
Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in PyTorch.
attention-visualization bert fine-tuning imdb-dataset language-modeling natural-language-understanding pytorch
Language:Python 108
geyingli / unif
基于 Tensorflow，仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类，涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域
nlp tensorflow language-modeling mrc classification transformer distillation gpu-training bert deep-learning
Language:Python 106
EgoAlpha / prompt-in-context-learning
Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
chain-of-thought chatbot chatgpt chatgpt-api cot in-context-learning language-modeling language-understanding large-language-model llm pre-training prompt prompt-based-learning prompt-design prompt-engineering prompt-learning prompt-toolkit prompt-tuning
Language:CSS 102
kmario23 / KenLM-training
Training an n-gram based Language Model using KenLM toolkit for Deep Speech 2
natural-language-processing language-modeling automatic-speech-recognition deep-neural-networks kenlm-toolkit kenlm language-model probabilistic-models deep-speech speech-recognition python
96
lucidrains / gated-state-spaces-pytorch
Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
artificial-intelligence deep-learning language-modeling state-spaces
Language:Python 82
lyeoni / pretraining-for-language-understanding
Pre-training of Language Models for Language Understanding
language-model language-modeling language-understanding pytorch-tutorial nlp pytorch
Language:Python 79
indiejoseph / chinese-char-rnn
Character-Level language models
deep-learning language-modeling tensorflow rnn chinese nlp
Language:Python 78
nstrodt / UDSMProt
Protein sequence classification with self-supervised pretraining
machine-learning deep-learning language-modeling protein-classification
Language:Python 72
referit3d / referit3d
Code accompanying our ECCV-2020 paper on 3D Neural Listeners.
deep-learning multimodal-deep-learning language-modeling rgbd computer-vision computer-graphics
Language:C++ 66
freon4dsl / Freon4dsl
Web Native language Workbench with Projectional Web Editor
domain-specific-language dsl language-modeling projectional-editor typescript svelte
Language:TypeScript 54
shaoxiongji / fed-att
Attentive Federated Learning for Private NLM
language-modeling federated-learning attention-mechanism pytorch deep-learning
Language:Python 53
miras-tech / MirasText
MirasText
nlp persian-nlp language-modeling text-corpus dataset corpus article sentiment-analysis irony-detection word-embedding
Language:Python 52
prajjwal1 / language-modelling
LM, ULMFit et al.
language-modeling nlp pytorch deep-learning
Language:Python 46
p-lambda / incontext-learning
Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implicit Bayesian Inference"
gpt-3 language-modeling few-shot-learning in-context-learning dataset
Language:Python 45
machelreid / m2d2
M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
dataset domain language-modeling multi-domain
Language:Python 43
uyaseen / theano-recurrence
Recurrent Neural Networks (RNN, GRU, LSTM) and their Bidirectional versions (BiRNN, BiGRU, BiLSTM) for word & character level language modelling in Theano
rnn gru lstm bidirectional-rnn bidirectional-gru bidirectional-lstm language-modeling theano natural-language-processing
Language:Python 42