No module named 'oslo.torch.experimental' when running mbart test

[Jose Lopez]

How to reproduce

python ./tests/transformers/models/mbart/test_training.py

Environment

• OS : CentOS 7.9
• Python version : 3.9
• Transformers version : 4.21.2
• Whether to use Docker:
• Misc.:

File "./tests/transformers/models/mbart/test_training.py", line 2, in <module>
    from oslo.transformers.trainer import Trainer as OTrainer
  File "/opt/conda/lib/python3.7/site-packages/oslo_core-3.0.0-py3.7.egg/oslo/transformers/trainer.py", line 27, in <module>
    from oslo.torch.nn.parallel.data_parallel import (
  File "/opt/conda/lib/python3.7/site-packages/oslo_core-3.0.0-py3.7.egg/oslo/torch/nn/parallel/__init__.py", line 1, in <module>
    from oslo.torch.nn.parallel.data_parallel import *
  File "/opt/conda/lib/python3.7/site-packages/oslo_core-3.0.0-py3.7.egg/oslo/torch/nn/parallel/data_parallel/__init__.py", line 4, in <module>
    from oslo.torch.nn.parallel.data_parallel.fully_sharded_data_parallel import (
  File "/opt/conda/lib/python3.7/site-packages/oslo_core-3.0.0-py3.7.egg/oslo/torch/nn/parallel/data_parallel/fully_sharded_data_parallel.py", line 56, in <module>
    from oslo.torch.nn.parallel.data_parallel._flatten_params_wrapper import (
  File "/opt/conda/lib/python3.7/site-packages/oslo_core-3.0.0-py3.7.egg/oslo/torch/nn/parallel/data_parallel/_flatten_params_wrapper.py", line 34, in <module>
    from oslo.torch.experimental.nn.ssd_offload import SsdFlatParameter
ModuleNotFoundError: No module named 'oslo.torch.experimental'

I've changed included __init__.py in the experimental folder to continue with the tests.

[Kevin Ko]

Fixed by #16