Language Media Processing Lab, Kyoto University

jumanpp

Juman++ (a Morphological Analyzer Toolkit)

kwja

An integrated Japanese analyzer based on foundation models

pyknp

A Python Module for JUMAN++/KNP

KWDLC

Kyoto University Web Document Leads Corpus

KyotoCorpus

Kyoto University Text Corpus

ja-vicuna-qa-benchmark

rhoknp

Yet another Python binding for Juman++/KNP/KWJA

knp

A Japanese Parser

bertknp

A Japanese dependency parser based on BERT

AnnotatedFKCCorpus

Annotated Fuman Kaitori Center Corpus

text-cleaning

A powerful text cleaner for Japanese web texts

VISA

An ambiguous subtitles dataset for visual scene-aware machine translation

WikipediaAnnotatedCorpus

kyoto-reader

A processor for KyotoCorpus, KWDLC, and AnnotatedFKCCorpus

pyknp-eventgraph

KyotoCorpusAnnotationTool

An annotation tool for the Kyoto University Corpus

KUCI

Kyoto University Commonsense Inference dataset (KUCI)

dockerfile-jumanpp-knp

Dockerfiles for Juman++, KNP, and KWJA

speechBSD

An extension of the BSD corpus with audio and speaker attribute information

video-helpful-MMT

sdg4idrr

Synthetic Data Generation for Implicit Discourse Relation Recognition (SDG4IDRR)

SMD4FVG

Flexible Visual Grounding

Abstractive-Multi-Video-Captioning

The implementation of the paper "Abstractive Multi-Video Captioning: Benchmark Dataset Construction and Extensive Evaluation."

AbstrActs

Benchmark dataset for abstractive multi-video captioning.

ARKitSceneRefer

ARKitSceneRefer: Text-based Localization of Small Objects in Diverse Real-World 3D Indoor Scenes (EMNLP 2023 Findings)

CNER_WT-WF

EaST-MELD

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

JumanDIC-py

A Python API for JumanDIC.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.