Replace experimental Distribution Strategies with non-experimental API

Question

Replace experimental Distribution Strategies with non-experimental API

dustinvtran opened this issue 4 years ago · comments

Dustin Tran commented 4 years ago

For consistency, we should probably do across baselines.

s/tf.distribute.experimental.TPUStrategy/tf.distribute.TPUStrategy
s/strategy.experimental_distribute_datasets_from_function/strategy.distribute_datasets_from_function

04d4241

Dustin Tran · Answer 1 · Wed Oct 28 2020 02:00:21 GMT+0800 (China Standard Time)

Also related is to replace distribute_datasets_from_function with distribute_dataset. This removes the need for the input_fn wrapper which adds some needless complexity. Using the function wrapper had slight performance improvements IIRC in 2019/early 2020. We should re-verify if that's the case. I think @ywen666 had checked 2-3 months ago that it no longer mattered.

Dustin Tran · Answer 2 · Sat Oct 31 2020 07:06:14 GMT+0800 (China Standard Time)

Solved with #218, #221, #219.