Interpret evaluation results

[Victoria X Lin]

Should we find dev evaluation results in runs/demo_run/dev.log?

My log says

{"accuracy": 0.6031746031746031, "oracle_accuracy": 0.7380952380952381}

which seems to be too high for WikiTableQuestions..

[Fu Zhiyi]

The config file is updated, with which I got a reasonable results. You can try it.

[Victoria X Lin]

Thanks, looks like the original evaluation script points to a slice of training data.