forrestdavis

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

annotated-transformer

An annotated implementation of the Transformer paper.

BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

transformer-xl-chinese

transformer xl在中文文本生成上的尝试（可写小说、古诗）（transformer xl for text generation of chinese）

Prosodylab-Aligner

Python interface for forced audio alignment using HTK and SoX

knnlm

CKA-Centered-Kernel-Alignment

Reproduce CKA: Similarity of Neural Network Representations Revisited

rnng

Recurrent neural network grammars

lm-debugger

The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.

CRD3

The repo containing the Critical Role Dungeons and Dragons Dataset.

minicons

Utility for behavioral and representational analyses of Language Models

diagNNose

diagNNose is a Python library that facilitates a broad set of tools for analysing hidden activations of neural models.

attract-repel

The Attract-Repel algorithm presented in (Mrkšić et al., TACL 2017), with accompanying resources.

KERMIT

🐸 KERMIT - A lightweight library to encode and interpret Universal Syntactic Embeddings

gpt2-recycle

As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)

Grounding_in_Dialogue

ACL 2020 Tutorial by Malihe Alikhani and Matthew Stone

amnesic_probing

syntactic-generalization

Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"

CCM-site

Computational Cognitive Modeling (Spring 2024)

mdlrnn

Minimum Description Length Recurrent Neural Networks

wugs-and-daxes

Collection of academic works in natural language processing, computational linguistics, and computational cognitive science that study the problem of novel words in models/agents.

multilingual-data-stats

Statistics on multilingual datasets

prosem

Prosody-semantics Interface in Seoul Korean

better-mlm-scoring

[Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring

comps

Conceptual Minimal Pairs

c-psyd.github.io

minimal-category-abstraction

Minimal implementation of Kim and Smolensky (2021) along with bells and whistles introduced by Misra and Kim (2023)

simpleweather