Giters

Samsung / ONE

On-device Neural Engine

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[one-quantize] does not stop when record-minmax fails

seanshpark opened this issue · comments

commented

Running one-quantize with input_data,

[one-quantize]
...
input_data=some_data.input.h5

but without the .h5 file, record-minmax tool seems to fail with

record-minmax:     minor: Unable to open file
record-minmax: ERROR: HDF5 error occurred.

but one-quantize or onecc doesn't stop with error.

commented

When I ran the onecc_006.test onecc test without input data file, it caused following errors.

cat onecc_006.log 
2024-04-19 11:40:37.702492: I tensorflow/core/util/port.cc:110] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
2024-04-19 11:40:37.717991: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
/home/seongwoo/ONE/build/install/bin/venv/lib/python3.10/site-packages/tensorflow_addons/utils/tfa_eol_msg.py:23: UserWarning: 

TensorFlow Addons (TFA) has ended development and introduction of new features.
TFA has entered a minimal maintenance and release mode until a planned end of life in May 2024.
Please modify downstream libraries to take dependencies from other repositories in our TensorFlow community (e.g. Keras, Keras-CV, and Keras-NLP). 

For more information see: https://github.com/tensorflow/addons/issues/2807 

  warnings.warn(
2024-04-19 11:40:40.526867: W tensorflow/compiler/mlir/lite/python/tf_tfl_flatbuffer_helpers.cc:364] Ignored output_format.
2024-04-19 11:40:40.526887: W tensorflow/compiler/mlir/lite/python/tf_tfl_flatbuffer_helpers.cc:367] Ignored drop_control_dependency.
/home/seongwoo/ONE/build/install/bin/record-minmax: HDF5-DIAG: Error detected in HDF5 (1.8.16) thread 0:
/home/seongwoo/ONE/build/install/bin/record-minmax:   #000: /home/seongwoo/ONE/externals/HDF5/src/H5F.c line 439 in H5Fis_hdf5(): unable open file
/home/seongwoo/ONE/build/install/bin/record-minmax:     major: File accessibilty
/home/seongwoo/ONE/build/install/bin/record-minmax:     minor: Not an HDF5 file
/home/seongwoo/ONE/build/install/bin/record-minmax:   #001: /home/seongwoo/ONE/externals/HDF5/src/H5Fint.c line 554 in H5F_is_hdf5(): unable to open file
/home/seongwoo/ONE/build/install/bin/record-minmax:     major: Low-level I/O
/home/seongwoo/ONE/build/install/bin/record-minmax:     minor: Unable to initialize object
/home/seongwoo/ONE/build/install/bin/record-minmax:   #002: /home/seongwoo/ONE/externals/HDF5/src/H5FD.c line 993 in H5FD_open(): open failed
/home/seongwoo/ONE/build/install/bin/record-minmax:     major: Virtual File Layer
/home/seongwoo/ONE/build/install/bin/record-minmax:     minor: Unable to initialize object
/home/seongwoo/ONE/build/install/bin/record-minmax:   #003: /home/seongwoo/ONE/externals/HDF5/src/H5FDsec2.c line 339 in H5FD_sec2_open(): unable to open file: name = 'inception_v3_test_data.h55', errno = 2, error message = 'No such file or directory', flags = 0, o_flags = 0
/home/seongwoo/ONE/build/install/bin/record-minmax:     major: File accessibilty
/home/seongwoo/ONE/build/install/bin/record-minmax:     minor: Unable to open file
/home/seongwoo/ONE/build/install/bin/record-minmax: HDF5-DIAG: Error detected in HDF5 (1.8.16) thread 0:
/home/seongwoo/ONE/build/install/bin/record-minmax:   #000: /home/seongwoo/ONE/externals/HDF5/src/H5F.c line 439 in H5Fis_hdf5(): unable open file
/home/seongwoo/ONE/build/install/bin/record-minmax:     major: File accessibilty
/home/seongwoo/ONE/build/install/bin/record-minmax:     minor: Not an HDF5 file
/home/seongwoo/ONE/build/install/bin/record-minmax:   #001: /home/seongwoo/ONE/externals/HDF5/src/H5Fint.c line 554 in H5F_is_hdf5(): unable to open file
/home/seongwoo/ONE/build/install/bin/record-minmax:     major: Low-level I/O
/home/seongwoo/ONE/build/install/bin/record-minmax:     minor: Unable to initialize object
/home/seongwoo/ONE/build/install/bin/record-minmax:   #002: /home/seongwoo/ONE/externals/HDF5/src/H5FD.c line 993 in H5FD_open(): open failed
/home/seongwoo/ONE/build/install/bin/record-minmax:     major: Virtual File Layer
/home/seongwoo/ONE/build/install/bin/record-minmax:     minor: Unable to initialize object
/home/seongwoo/ONE/build/install/bin/record-minmax:   #003: /home/seongwoo/ONE/externals/HDF5/src/H5FDsec2.c line 339 in H5FD_sec2_open(): unable to open file: name = 'inception_v3_test_data.h55', errno = 2, error message = 'No such file or directory', flags = 0, o_flags = 0
/home/seongwoo/ONE/build/install/bin/record-minmax:     major: File accessibilty
/home/seongwoo/ONE/build/install/bin/record-minmax:     minor: Unable to open file
/home/seongwoo/ONE/build/install/bin/record-minmax: ERROR: HDF5 error occurred.

Seems that onecc stopped after the errors and didn't run one-codgen.

Could you let me know the cases for the reproduction?

commented

Could you let me know the cases for the reproduction?

It's from internal CI system. I've left a new issue for this.

commented

Now it's work but not sure what was the problem...
Closing as there is no issue.