lxuechen / private-transformers

A codebase that makes differentially private training of transformers easy.

Home Page:https://arxiv.org/abs/2110.05679

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

no metrics: BLEU or Rouge-L

adam-dziedzic opened this issue · comments

For the text-to-table task, there is no code to compute the metrics. When I run your training, there is no possibility of assessing how well it went? What was your approach to compute the metrics?

The table2text example code should periodically generate samples, with which you could evaluate standard NLG metrics using this codebase.

This was documented here.

Okay, thanks.