language-modeling

There are 16 repositories under language-modeling topic.

quark0 / darts
Differentiable architecture search for convolutional and recurrent networks
deep-learning automl image-classification language-modeling pytorch convolutional-networks recurrent-networks neural-architecture-search
Language:Python 3858
RL4LMs
allenai / RL4LMs
A modular RL library to fine-tune language models to human preferences
language-modeling nlp reinforcement-learning dialogue-generation machine-translation natural-language-processing summarization table-to-text text-generation
Language:Python 2087
EgoAlpha / prompt-in-context-learning
Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
chain-of-thought chatbot chatgpt chatgpt-api cot in-context-learning language-modeling language-understanding large-language-model llm pre-training prompt prompt-based-learning prompt-design prompt-engineering prompt-learning prompt-toolkit prompt-tuning
Language:Jupyter Notebook 1342
uber-research / PPLM
Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
deep-learning language-modeling machine-learning natural-language-generation natural-language-processing nlp
Language:Python 1112
lingua-go
pemistahl / lingua-go
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
natural-language-processing language-detection language-recognition language-classification language-identification language-processing nlp nlp-machine-learning golang-library go language-modeling text-processing
Language:Go 1096
Separius / BERT-keras
Keras implementation of BERT with pre-trained weights
keras transformer theano language-modeling nlp transfer-learning pretrained-models tensorflow
Language:Python 814
meta-toolkit / meta
A Modern C++ Data Sciences Toolkit
nlp nlp-parsing search-engine inverted-index pos-tag text-analysis text-analytics text-classification language-modeling graph-algorithms c-plus-plus word-embeddings
Language:C++ 685
songlab-cal / tape
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology.
deep-learning protein-sequences protein-structure semi-supervised-learning benchmark language-modeling dataset pytorch
Language:Python 628
hirofumi0810 / neural_sp
End-to-end ASR/LM implementation with PyTorch
pytorch speech-recognition automatic-speech-recognition asr ctc attention-mechanism attention seq2seq sequence-to-sequence speech language-model transformer language-modeling rnn-transducer transformer-xl streaming
Language:Python 585
DmitryRyumin / INTERSPEECH-2023-Papers
INTERSPEECH 2023 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023 conference. Explore the latest advances in speech and language processing. Code included. Star the repository to support the advancement of speech technology!
interspeech speech-technology machine-translation speech-synthesis asr prosody self-supervised-learning speech-production speech-coding transmission acoustic adaptation robustness signal-processing speech-recognition audio-signals speech-analysis linguistic-analysis language-modeling lexical-analysis
575
jeffhj / LM-reasoning
This repository contains a collection of papers and resources on Reasoning in Large Language Models.
large-language-models reasoning deductive-reasoning natural-language-processing artificial-intelligence human-intelligence language-modeling language-models awesome-list chain-of-thought paper-list in-context-learning prompt-learning chatgpt gpt-3 llm prompt-engineering
494
yxuansu / SimCTG
[NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
textgeneration contrastive-learning nlp languagemodel decode language-modeling deeplearning
Language:Python 444
google-deepmind / long-form-factuality
Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
benchmark dataset evaluation factuality language language-modeling large-language-models metrics
Language:Python 434
majumderb / rezero
Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
pytroch transformer resnet language-modeling deep-neural-networks
Language:Python 400
madaan / memprompt
A method to fix GPT-3 after deployment with user feedback, without re-training.
language-generation prompt-tuning language-modeling gpt-3 gpt-3-prompt feedback few-shot-learning user-feedback
Language:Python 321
L0SG / relational-rnn-pytorch
An implementation of DeepMind's Relational Recurrent Neural Networks (NeurIPS 2018) in PyTorch.
pytorch language-model word-language-model language-modeling deep-learning recurrent-neural-networks deepmind transformer self-attention
Language:Python 246
DmitryRyumin / ICASSP-2023-24-Papers
ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore the latest advancements in acoustics, speech and signal processing. Code included. Star the repository to support the advancement of audio and signal processing!
asr denoising domain-adaptation face-recognition icassp icassp2023 keyword-spotting language-modeling self-supervised-learning semantic-segmentation signal-processing signal-restoration speech-recognition vad generative-models image-generation music-generation spoken-language-understanding multimodal-learning icassp2024
Language:Python 219
shmsw25 / FActScore
A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
factuality language language-modeling evaluation emnlp2023
Language:Python 210
UIC-Liu-Lab / ContinualLM
An Extensible Continual Learning Framework Focused on Language Models (LMs)
catastrophic-forgetting continual-learning knowledge-transfer language-model domain-adaptive-pretraining transfer-learning transformer-architecture natural-language-processing language-modeling
Language:Python 206
somosnlp / nlp-de-cero-a-cien
Curso práctico: NLP de cero a cien 🤗
nlp natural-language-processing espanol transformers transfer-learning language-modeling word-embeddings rnn lstm attention-mechanism
Language:Jupyter Notebook 179
rusiaaman / XLnet-gen
XLNet for generating language.
xlnet text language-model language-modeling language-generation gpt2 transformer-xl
Language:Python 165
tonybeltramelli / Deep-Lyrics
Lyrics Generator aka Character-level Language Modeling with Multi-layer LSTM Recurrent Neural Network
deep-learning recurrent-neural-networks tensorflow natural-language-processing language-modeling
Language:Python 143
Sunnydreamrain / IndRNN_pytorch
Independently Recurrent Neural Networks (IndRNN) implemented in pytorch.
action indrnn language-modeling rnn skeleton
Language:Python 131
suriyadeepan / rnn-from-scratch
Use tensorflow's tf.scan to build vanilla, GRU and LSTM RNNs
tensorflow rnn recurrent-neural-networks language-modeling
Language:Python 127
songlab-cal / tape-neurips2019
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology. (DEPRECATED)
deep-learning protein-sequences protein-structure semi-supervised-learning benchmark language-modeling dataset
Language:Python 117
uzaymacar / comparatively-finetuning-bert
Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in PyTorch.
natural-language-understanding language-modeling fine-tuning imdb-dataset bert attention-visualization pytorch
Language:Python 115
geyingli / unif
基于 Tensorflow，仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类，涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域
nlp tensorflow language-modeling mrc classification transformer distillation gpu-training bert deep-learning
Language:Python 112
kmario23 / KenLM-training
Training an n-gram based Language Model using KenLM toolkit for Deep Speech 2
natural-language-processing language-modeling automatic-speech-recognition deep-neural-networks kenlm-toolkit kenlm language-model probabilistic-models deep-speech speech-recognition python
110
jiali-ms / JLM
A fast LSTM Language Model for large vocabulary language like Japanese and Chinese
tensorflow language-modeling lstm decoder deep-neural-networks beam-search viterbi
Language:Python 109
DRSY / EMO
[ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
language-modeling
Language:Python 100
flatironinstitute / deepblast
Neural Networks for Protein Sequence Alignment
structural-alignments neural-networks sequence-alignment language-modeling protein-sequences protein protein-structure
Language:Python 97
referit3d / referit3d
Code accompanying our ECCV-2020 paper on 3D Neural Listeners.
deep-learning multimodal-deep-learning language-modeling rgbd computer-vision computer-graphics
Language:C++ 95
lucidrains / gated-state-spaces-pytorch
Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
artificial-intelligence deep-learning language-modeling state-spaces
Language:Python 94
euclaise / SlimTrainer
Full finetuning of large language models without large memory requirements
language-modeling llama transformers
Language:Python 92
p-lambda / incontext-learning
Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implicit Bayesian Inference"
gpt-3 language-modeling few-shot-learning in-context-learning dataset
Language:Python 90
lyeoni / pretraining-for-language-understanding
Pre-training of Language Models for Language Understanding
language-model language-modeling language-understanding pytorch-tutorial nlp pytorch
Language:Python 82

language-modeling

quark0 / darts

allenai / RL4LMs

EgoAlpha / prompt-in-context-learning

uber-research / PPLM

pemistahl / lingua-go

Separius / BERT-keras

meta-toolkit / meta

songlab-cal / tape

hirofumi0810 / neural_sp

DmitryRyumin / INTERSPEECH-2023-Papers

jeffhj / LM-reasoning

yxuansu / SimCTG

google-deepmind / long-form-factuality

majumderb / rezero

madaan / memprompt

L0SG / relational-rnn-pytorch

DmitryRyumin / ICASSP-2023-24-Papers

shmsw25 / FActScore

UIC-Liu-Lab / ContinualLM

somosnlp / nlp-de-cero-a-cien

rusiaaman / XLnet-gen

tonybeltramelli / Deep-Lyrics

Sunnydreamrain / IndRNN_pytorch

suriyadeepan / rnn-from-scratch

songlab-cal / tape-neurips2019

uzaymacar / comparatively-finetuning-bert

geyingli / unif

kmario23 / KenLM-training

jiali-ms / JLM

DRSY / EMO

flatironinstitute / deepblast

referit3d / referit3d

lucidrains / gated-state-spaces-pytorch

euclaise / SlimTrainer

p-lambda / incontext-learning

lyeoni / pretraining-for-language-understanding