jasivan / FERMAT

An Alternative to Accuracy for Numerical Reasoning

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

FERMAT: An Alternative to Accuracy for Numerical Reasoning

This is the repository for FERMAT: An Alternative to Accuracy for Numerical Reasoning by Jasivan Alex Sivakumar and Nafise Sadat Moosavi accepted at ACL 2023.

You can find the codes, templates and test sets in their respective folders. Note that the codes folder is still being updated.

Usage

Requirements

Install the packages from the requirements.txt file (transformers, torch, datasets, accelerate, SentencePiece, json, pandas, numpy).

Reference

If you use this code in your work, please cite the paper:

@InProceedings{sivakumar-moosavi_2023_FERMAT,
    author = { Jasivan Alex Sivakumar, Nafise Sadat Moosavi},
    title = {FERMAT: An Alternative to Accuracy for Numerical Reasoning},
    year = {2023},
    booktitle = {Proceedings of the 61st Annual Meeting of
		the Association for Computational Linguistics (Volume 1: Long Papers)},
    publisher = {Association for Computational Linguistics},
    address = {Toronto, Canada},
}

Authors

This code was written by @jasivan.

If you have any queries or comments, please email jasivakumar1@sheffield.ac.uk .

About

An Alternative to Accuracy for Numerical Reasoning

License:MIT License


Languages

Language:q 98.9%Language:Python 1.1%