abachaa / MEDIQA2021

MEDIQA2021

The second edition of the MEDIQA challenge will be organized at NAACL-BioNLP 2021 and will focus on summarization in the medical domain with three tasks: Consumer health question summarization, Multi-answer summarization, and Radiology report summarization.

• Website: https://sites.google.com/view/mediqa2021

• Paper: https://www.aclweb.org/anthology/2021.bionlp-1.8.pdf

• Post-challenge Round: https://www.aicrowd.com/challenges/mediqa-2021

• Mailing list: https://groups.google.com/forum/#!forum/bionlp-mediqa

• Previous edition: https://sites.google.com/view/mediqa2019 & https://github.com/abachaa/MEDIQA2019

Tasks:

Task 1 (question summarization): https://github.com/abachaa/MEDIQA2021/tree/main/Task1

Task 2 (multi-answer summarization): https://github.com/abachaa/MEDIQA2021/tree/main/Task2

Task 3 (radiology report summarization): https://github.com/abachaa/MEDIQA2021/tree/main/Task3

Evaluation:

• The AIcrowd platform will be used for releasing the test sets and submitting runs.

• ROUGE will be used as the main metric to rank the participating teams, but we will also use several evaluation metrics more adapted to each task such as HOLMS and CheXbert.

Registration:

The registration & data usage agreement form is available under the Resources section of the AIcrowd projects. The form covers the three tasks. You can download it from any of the three MEDIQA projects: QS@AIcrowd, MAS@AIcrowd & RRS@AIcrowd.
To register, you need to complete, sign, and upload the form. When approved, you will be able to download the official test sets and to submit your runs on the AIcrowd submission systems.

Organizers:

• Asma Ben Abacha, NLM/NIH
• Chaitanya Shivade, Amazon
• Yassine Mrabet, NLM/NIH
• Yuhao Zhang, Stanford University
• Curtis Langlotz, Stanford University
• Dina Demner-Fushman, NLM/NIH