stefan-it

grok-1

Grok open release

surya

OCR, layout analysis, reading order, line detection in 90+ languages

KeyBERT

Minimal keyword extraction with BERT

torchtitan

A native PyTorch Library for large model training

uform

Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️

llm2vec

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

recurrentgemma

Open weights language model from Google DeepMind, based on Griffin.

community-content

Hetzner Online Community Project

LEAR

The implementation our EMNLP 2021 paper "Enhanced Language Representation with Label Knowledge for Span Extraction".

zett

Code for Zero-Shot Tokenizer Transfer

scaling

Language models scale reliably with over-training and on downstream tasks

improved-t5

Experiments for efforts to train a new and improved t5

ScandEval

Evaluation of language models on mono- or multilingual tasks.

Next-Token-Failures

spacebyte

A byte-level decoder architecture that matches the performance of tokenized Transformers.

albnlp

transformer-smaller-training-vocab

Temporary remove unused tokens during training to save ram and speed.

causallm_icl

fundus-evaluation

Evaluation of the Fundus News Scraper https://github.com/flairNLP/fundus

BEAR

BEAR dataset

eacl24-german-legal-questions

Data and code: "Answering legal questions from laymen in German civil law system", Büttner & Habernal, EACL'24

tech-report

Raw data, scripts, etc. to produce the tables and figures of our technical report

ChroniclingAmericaQA

ChroniclingAmericaQA: A Large-scale Question Answering Dataset based on Historical American Newspaper Pages

Multi-Level-Training-Framework

Official implementation of "A Multi-level Framework for Accelerating Training Transformer Models""

XAMPLER

XAMPLER: Learning to Retrieve Cross-Lingual In-Context Examples

umLabeller

Inspection tool for characterizing the semantic compositionality of subword tokenization in English

UD_Bavarian-MaiBaam

newsagency-classification

Recognition of news agency mentions in historical news articles (BERT-based token classification).

maibaam-code

Code for preprocessing data for UD annotations and for tagging/parsing experiments of MaiBaam

turkish-lm-bias

Investigating Gender Bias in Turkish Language Models