v0.28.1 Version Mismatch with TF 2.12.0. Works with v0.28.0
liamaltarac opened this issue · comments
Liam Altarac commented
Environment:
- Framework: TensorFlow, Keras
- Framework version: 2.12.0
- Horovod version: 0.28.1
- MPI version:
- CUDA version:
- NCCL version:
- Python version: 3.10
- Spark / PySpark version:
- Ray version:
- OS and version:
- GCC version:
- CMake version:
Bug report:
- pip install keras==2.12.0
- pip install tensorflow==2.12.0
- HOROVOD_WITH_TENSORFLOW=1 pip install horovod
- (in python) : import horovod.keras as hvd
I get this error:
horovod.common.exceptions.HorovodVersionMismatchError: Framework tensorflow installed with version 2.14.0 but found version 2.12.0.
This can result in unexpected behavior including runtime errors.
Reinstall Horovod usingpip install --no-cache-dir
to build with the new version.
I tried reinstalling Horovod with --no-cache-dir, but it still gave the same error.
It works however when I install with Horovod v0.28.0