jasonwei20 / jasonwei20.github.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Hi, I can't contact you via email.

beyondguo opened this issue · comments

Hi Jason!
Sorry to interrupt you. I can't contact you via email. I have to try this place.

I am very interested in your EMNLP paper "Good-Enough Example Extrapolation", which provides me lots of inspirations.

When reading the paper, I have some questions :

  1. You mentioned that " implement GE3 at this final max-pooled hidden layer, which has size 768. That is, the hidden-space augmentation method only updates classifier weights after the BERT encoder", do you mean the weights of transformer are frozen during training? This is a very important detail when I reimplement your paper.
  2. GE3 needs to average the hidden vectors of all samples in the same class. So how to implement it in a mini-batch training? Or did you implement the GE3 in a two-stage way: First use BERT to get all vectors, and use GE3 for feature augmentation, then use a simple classifier to train on top of these features?
  3. Could you please provide the source code? I am new to this area and I really want to study this method by code.

I would appreciate it if you could answer my questions and provide the source code. In fact, I am also quite interested in data augmentation and have cited your EDA and other works in my paper and working papers. I look forward to communicate with you! Thanks a lot.