OyvindTafjord

allennlp

An open-source NLP research library, built on PyTorch.

MRQA-Shared-Task-2019

Resources for the MRQA 2019 Shared Task

allennlp-demo

code for demo.allennlp.org

catwalk

This project studies the performance and robustness of language models and task-adaptation methods.

datasets

🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools

deep_qa

A deep NLP library, based on Keras / tf, focused on question answering (but useful for other NLP too)

drop-leaderboard-example

An example submission to the AllenAI DROP leaderboard

dynet

Dynamic neural network library

figureseer

helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).

jklol

Jayant Krishnamurthy's (machine) Learning and Optimization Library

lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

mesh

Mesh TensorFlow: Model Parallelism Made Easier

open-instruct

pipeline

Library for building reproducible data pipelines to support experimentation

pnp

Probabilistic Neural Programming

transformers

PyTorch version of Google AI's BERT model with script to load Google's pre-trained models