language-modeling

There are 16 repositories under language-modeling topic.

quark0 / darts
Differentiable architecture search for convolutional and recurrent networks
deep-learning automl image-classification language-modeling pytorch convolutional-networks recurrent-networks neural-architecture-search
Language:Python 3972
RL4LMs
allenai / RL4LMs
A modular RL library to fine-tune language models to human preferences
dialogue-generation language-modeling machine-translation natural-language-processing nlp reinforcement-learning summarization table-to-text text-generation
Language:Python 2297
EgoAlpha / prompt-in-context-learning
Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
chain-of-thought chatbot chatgpt chatgpt-api cot in-context-learning language-modeling language-understanding large-language-model llm pre-training prompt prompt-based-learning prompt-design prompt-engineering prompt-learning prompt-toolkit prompt-tuning
Language:Jupyter Notebook 1576
lingua-go
pemistahl / lingua-go
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
natural-language-processing language-detection language-recognition language-classification language-identification language-processing nlp nlp-machine-learning golang-library go language-modeling text-processing
Language:Go 1232
uber-research / PPLM
Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
deep-learning language-modeling machine-learning natural-language-generation natural-language-processing nlp
Language:Python 1151
Separius / BERT-keras
Keras implementation of BERT with pre-trained weights
keras transformer theano language-modeling nlp transfer-learning pretrained-models tensorflow
Language:Python 814
songlab-cal / tape
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology.
deep-learning protein-sequences protein-structure semi-supervised-learning benchmark language-modeling dataset pytorch
Language:Python 717
meta-toolkit / meta
A Modern C++ Data Sciences Toolkit
c-plus-plus graph-algorithms inverted-index language-modeling nlp nlp-parsing pos-tag search-engine text-analysis text-analytics text-classification word-embeddings
Language:C++ 704
DmitryRyumin / INTERSPEECH-2023-24-Papers
INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. Explore the latest advances in speech and language processing. Code included. Star the repository to support the advancement of speech technology!
interspeech speech-technology machine-translation speech-synthesis asr prosody self-supervised-learning speech-production transmission acoustic adaptation signal-processing speech-recognition audio-signals speech-analysis linguistic-analysis language-modeling lexical-analysis interspeech2023 interspeech2024
682
hirofumi0810 / neural_sp
End-to-end ASR/LM implementation with PyTorch
pytorch speech-recognition automatic-speech-recognition asr ctc attention-mechanism attention seq2seq sequence-to-sequence speech language-model transformer language-modeling rnn-transducer transformer-xl streaming
Language:Python 596
google-deepmind / long-form-factuality
Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
benchmark dataset evaluation factuality language language-modeling large-language-models metrics
Language:Python 592
jeffhj / LM-reasoning
This repository contains a collection of papers and resources on Reasoning in Large Language Models.
large-language-models reasoning deductive-reasoning natural-language-processing artificial-intelligence human-intelligence language-modeling language-models awesome-list chain-of-thought paper-list in-context-learning prompt-learning chatgpt gpt-3 llm prompt-engineering
561
yxuansu / SimCTG
[NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
textgeneration contrastive-learning nlp languagemodel decode language-modeling deeplearning
Language:Python 473
DmitryRyumin / ICASSP-2023-24-Papers
ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore the latest advancements in acoustics, speech and signal processing. Code included. Star the repository to support the advancement of audio and signal processing!
asr denoising domain-adaptation face-recognition icassp icassp2023 keyword-spotting language-modeling self-supervised-learning semantic-segmentation signal-processing signal-restoration speech-recognition vad generative-models image-generation music-generation spoken-language-understanding multimodal-learning icassp2024
Language:Python 449
majumderb / rezero
Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
deep-neural-networks language-modeling pytroch resnet transformer
Language:Python 407
shmsw25 / FActScore
A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
emnlp2023 evaluation factuality language language-modeling
Language:Python 336
madaan / memprompt
A method to fix GPT-3 after deployment with user feedback, without re-training.
language-generation prompt-tuning language-modeling gpt-3 gpt-3-prompt feedback few-shot-learning user-feedback
Language:Python 328
PyxLSTM
muditbhargava66 / PyxLSTM
Efficient Python library for Extended LSTM with exponential gating, memory mixing, and matrix memory for superior sequence modeling.
language-modeling lstm sequence-modeling xlstm
Language:Python 287
UIC-Liu-Lab / ContinualLM
An Extensible Continual Learning Framework Focused on Language Models (LMs)
catastrophic-forgetting continual-learning knowledge-transfer language-model domain-adaptive-pretraining transfer-learning transformer-architecture natural-language-processing language-modeling
Language:Python 273
L0SG / relational-rnn-pytorch
An implementation of DeepMind's Relational Recurrent Neural Networks (NeurIPS 2018) in PyTorch.
deep-learning deepmind language-model language-modeling pytorch recurrent-neural-networks self-attention transformer word-language-model
Language:Python 246
somosnlp / nlp-de-cero-a-cien
Curso práctico: NLP de cero a cien 🤗
attention-mechanism espanol language-modeling lstm natural-language-processing nlp rnn transfer-learning transformers word-embeddings
Language:Jupyter Notebook 187
rusiaaman / XLnet-gen
XLNet for generating language.
xlnet text language-model language-modeling language-generation gpt2 transformer-xl
Language:Python 165
tonybeltramelli / Deep-Lyrics
Lyrics Generator aka Character-level Language Modeling with Multi-layer LSTM Recurrent Neural Network
deep-learning recurrent-neural-networks tensorflow natural-language-processing language-modeling
Language:Python 148
Sunnydreamrain / IndRNN_pytorch
Independently Recurrent Neural Networks (IndRNN) implemented in pytorch.
indrnn rnn action skeleton language-modeling
Language:Python 135
suriyadeepan / rnn-from-scratch
Use tensorflow's tf.scan to build vanilla, GRU and LSTM RNNs
tensorflow rnn recurrent-neural-networks language-modeling
Language:Python 127
referit3d / referit3d
Code accompanying our ECCV-2020 paper on 3D Neural Listeners.
deep-learning multimodal-deep-learning language-modeling rgbd computer-vision computer-graphics
Language:C++ 123
uzaymacar / comparatively-finetuning-bert
Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in PyTorch.
attention-visualization bert fine-tuning imdb-dataset language-modeling natural-language-understanding pytorch
Language:Python 123
DRSY / EMO
[ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
language-modeling
Language:Python 121
flatironinstitute / deepblast
Neural Networks for Protein Sequence Alignment
language-modeling neural-networks protein protein-sequences protein-structure sequence-alignment structural-alignments
Language:Python 120
songlab-cal / tape-neurips2019
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology. (DEPRECATED)
benchmark dataset deep-learning language-modeling protein-sequences protein-structure semi-supervised-learning
Language:Python 120
geyingli / unif
基于 Tensorflow，仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类，涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域
nlp tensorflow language-modeling mrc classification transformer distillation gpu-training bert deep-learning
Language:Python 114
kmario23 / KenLM-training
Training an n-gram based Language Model using KenLM toolkit for Deep Speech 2
natural-language-processing language-modeling automatic-speech-recognition deep-neural-networks kenlm-toolkit kenlm language-model probabilistic-models deep-speech speech-recognition python
114
jiali-ms / JLM
A fast LSTM Language Model for large vocabulary language like Japanese and Chinese
tensorflow language-modeling lstm decoder deep-neural-networks beam-search viterbi
Language:Python 109
p-lambda / incontext-learning
Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implicit Bayesian Inference"
dataset few-shot-learning gpt-3 in-context-learning language-modeling
Language:Python 105
lucidrains / gated-state-spaces-pytorch
Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
artificial-intelligence deep-learning language-modeling state-spaces
Language:Python 99
euclaise / SlimTrainer
Full finetuning of large language models without large memory requirements
language-modeling llama transformers
Language:Python 93