logs_rubi_val_oe.json not getting generated

[abhipsabasu]

When I run rubi, the following files are getting generated. No logs_rubi_val_oe.json is getting generated. Is it the rubi accuracy that is present in logs_val_oe.json? The numbers seem to be tallying with that of rubi as reported in the paper. Attaching the screenshot below.

[Corentin Dancette]

Can you check the _rubi_val_oe.json as well ? It seems more likely that logs are there, I'm not sure why it's missing the log prefix

[abhipsabasu]

On checking _rubi_val_oe.json, I saw the overall accuracy is max 37.22, whereas in logs_val_oe.json, the max accuracy is 48.01. So the latter score is matching with that of the paper isnt it?

[Corentin Dancette]

Yes you are correct In _rubi_val_oe there are the scores obtained by keeping the question only branch. Le jeu. 25 nov. 2021, 05:05, abhipsabasu ***@***.***> a écrit :

…

On checking _rubi_val_oe.json, I saw the overall accuracy is max 37.22, whereas in logs_val_oe.json, the max accuracy is 48.01. So the latter score is matching with that of the paper isnt it? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#15 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACQPYN5PZT6IEHRCVMBRZETUNWYXPANCNFSM5IV4GBOA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[abhipsabasu]

Okay thanks a lot

[abhipsabasu]

Hi,
In the paper, did you report the highest validation accuracy? or the validation accuracy obtained at the end of training?