kent0304 / llid_proto

Language Learning Image Description Feedback

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

LLID Feedback Prototype

This repository contains the automatic assessment system for Image Description by Language Learners.


We focus on image description and a corresponding assessment system for language learners. To achieve automatic assessment of image description, we construct a novel dataset, the Language Learner Image Description (LLID) dataset, which consists of images, their descriptions, and assessment annotations. Then, we propose a novel task of automatic error correction for image description, and we develop a baseline model that encodes multimodal information from a learner sentence with an image and accurately decodes a corrected sentence. Our experimental results show that the developed model can revise errors that cannot be revised without an image.


The easiest way to use LLID Feedback and its dependencies is using docker.

docker-compose build
docker-compose up

Pretrained Model and Image Features


Language Learning Image Description Feedback


Language:Python 73.1%Language:TypeScript 19.2%Language:SCSS 7.2%Language:Dockerfile 0.5%