Megagon Labs

ginza

A Japanese NLP Library using spaCy as framework based on Universal Dependencies

ditto

Code for the paper "Deep Entity Matching with Pre-trained Language Models"

bunkai

Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)

sato

Code and data for Sato https://arxiv.org/abs/1911.06311.

jrte-corpus

Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)

opiniondigest

OpinionDigest: A Simple Framework for Opinion Summarization (ACL 2020)

SubjQA

A question-answering dataset with a focus on subjective information

t5-japanese

Codes to pre-train Japanese T5 models

ruler

Data Programming by Demonstration (DPBD) for Document Classification

tagruler

Data programming by demonstration for information extraction and span annotation

coop

☘️ Code for Convex Aggregation for Opinion Summarization (Iso et al; Findings of EMNLP 2021)

UD_Japanese-GSD

Japanese data from the Google UDT 2.0.

doduo

Annotating Columns with Pre-trained Language Models

asdc

Accommodation Search Dialog Corpus (宿泊施設探索対話コーパス)

cocosum

:coconut: Code & Data for Comparative Opinion Summarization via Collaborative Decoding (Iso et al; Findings of ACL 2022)

rotom

Code for the paper "Rotom: A Meta-Learned Data Augmentation Framework for Entity Matching, Data Cleaning, Text Classification, and Beyond"

ebe-dataset

Evidence-based Explanation Dataset (AACL-IJCNLP 2020)

ginza-transformers

Use custom tokenizers in spacy-transformers

starmie

Resources for PVLDB 2023 submission

machamp

The dataset for the paper "Machamp: A Generalized Entity Matching Benchmark" published in CIKM 2021

teddy

Code and data for Teddy https://arxiv.org/abs/2001.05171.

sudowoodo

The source code of the Sudowoodo paper in ICDE 2023

desuwa

Feature annotator to morphemes and phrases based on KNP rule files (pure-Python)

explainit

react-jupyter-cookiecutter

jrte-corpus_example

Example codes for Japanese Realistic Textual Entailment Corpus

leam

Source code and demo for Leam

minun

Evaluating Counterfactual Explanations for Entity Matching

eseBench

albert

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations