Help with inference code.

[Snehal Patel]

I'm trying to digest how to use take the necessary pieces from the eval_end_to_end.sh script to use as inference. Any suggestions or plan to add instruction for this?

[Peng Qi]

The information we print with echo in that script should give you a high-level sense of what we're doing at each step, and should mirror the model diagram closely. So that is probably a good place to start!