mukulpatnaik / flan-t5-experiments

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

flan-t5-experiments

Evaluating Flan-T5 on some benchmarks

To run:

python evaluate.py [model_size] -b [benchmark] -n [number of questions]

model_size options: 'small', 'base', 'large', 'xl', 'xxl'

benchmark options: 'sat', 'mmlu'

About


Languages

Language:Jupyter Notebook 87.0%Language:Python 13.0%