onnxruntime_test_all (SEGFAULT) when building onnxruntime-gpu-tensorrt from source
MasterBin-IIAU opened this issue · comments
I am trying building onnxruntime from source to use the TensorRT execution provider in python.
My detailed environment is shown below.
- Ubuntu 16.04
- python 3.6
- gcc & g++ 7.5.0
- CUDA 10.2
- CUDNN 8.0.3
- TensorRT 7.1.3.4 (Downloaded from the official link and installed by "pip install tensorrt-7.1.3.4-cp36-none-linux_x86_64.whl")
- onnx 1.9.0 (installed by "pip install onnx")
I use the following command to build the project
./build.sh --cudnn_home /usr/local/cuda/lib64/ --cuda_home /usr/local/cuda --use_tensorrt --tensorrt_home /home/alphabin/zxh/TensorRT-7.1.3.4/ --parallel 32 --build_wheel
The build process was successful but the onnxruntime_test failed.
The detailed log is shown below. Due to the comment length limit, only the test part is posted here
[100%] Linking CXX executable onnxruntime_test_all
[100%] Built target onnxruntime_pybind11_state
[100%] Built target onnxruntime_test_all
2021-07-04 07:33:46,449 util.run [DEBUG] - Subprocess completed. Return code: 0
2021-07-04 07:33:46,449 build [INFO] - Running tests for Debug configuration
2021-07-04 07:33:46,449 util.run [INFO] - Running subprocess in '/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug'
['/usr/bin/ctest', '--build-config', 'Debug', '--verbose', '--timeout', '7200']
UpdateCTestConfiguration from :/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/DartConfiguration.tcl
Parse Config file:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/DartConfiguration.tcl
UpdateCTestConfiguration from :/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/DartConfiguration.tcl
Parse Config file:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/DartConfiguration.tcl
Test project /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug
Constructing a list of tests
Done constructing a list of tests
Updating test list for fixtures
Added 0 tests to meet fixture requirements
Checking test dependency graph...
Checking test dependency graph end
test 1
Start 1: onnxruntime_test_all
1: Test command: /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/onnxruntime_test_all "--gtest_output=xml:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/onnxruntime_test_all.Debug.results.xml"
1: Test timeout computed to be: 7200
1: [==========] Running 2887 tests from 218 test suites.
1: [----------] Global test environment set-up.
1: [----------] 1 test from DenormalTest
1: [ RUN ] DenormalTest.DenormalAsZeroTest
1: [ OK ] DenormalTest.DenormalAsZeroTest (0 ms)
1: [----------] 1 test from DenormalTest (0 ms total)
1:
1: [----------] 8 tests from LoggingTestsFixture
1: [ RUN ] LoggingTestsFixture.TestWhereMacro
1: TestBody
1: TestWhereMacro@2021-07-04 06:33:46.539815688 E:onnxruntime:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:82 TestBody Testing the WHERE macro.
1: [ OK ] LoggingTestsFixture.TestWhereMacro (0 ms)
1: [ RUN ] LoggingTestsFixture.TestDefaultFiltering
1: TestDefaultFiltering@2021-07-04 06:33:46.539957821 E:onnxruntime:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:106 TestBody hello
1: 2021-07-04 06:33:46.539982000 [W:onnxruntime:Default, logging_test.cc:109 TestBody] Warning
1: 2021-07-04 06:33:46.539998963 [E:onnxruntime:Default, logging_test.cc:110 TestBody] Default logger doesn't filter user data
1: 2021-07-04 06:33:46.540013470 [W:onnxruntime:Default, logging_test.cc:112 TestBody] Default logger doesn't filter user data
1: [ OK ] LoggingTestsFixture.TestDefaultFiltering (0 ms)
1: [ RUN ] LoggingTestsFixture.TestLoggerFiltering
1: TestLoggerFiltering@2021-07-04 06:33:46.540069101 V:onnxruntime:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:140 TestBody VERBOSE enabled in this logger
1: TestLoggerFiltering@2021-07-04 06:33:46.540092269 E:onnxruntime:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:141 TestBody USER data not filtered in this logger
1: TestLoggerFiltering@2021-07-04 06:33:46.540114168 V:VLOG2:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:142 TestBody VLOG enabled up to 2
1: [ OK ] LoggingTestsFixture.TestLoggerFiltering (0 ms)
1: [ RUN ] LoggingTestsFixture.TestLoggingManagerCtor
1: [ OK ] LoggingTestsFixture.TestLoggingManagerCtor (0 ms)
1: [ RUN ] LoggingTestsFixture.TestConditionalMacros
1: TestConditionalMacros@2021-07-04 06:33:46.540479257 I:onnxruntime:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:186 TestBody Valid logger
1: TestConditionalMacros@2021-07-04 06:33:46.540504137 I:onnxruntime:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:187 TestBody Logger is 0x391ab60
1: [ OK ] LoggingTestsFixture.TestConditionalMacros (0 ms)
1: [ RUN ] LoggingTestsFixture.TestVLog
1: TestVLog@2021-07-04 06:33:46.540567819 V:VLOGmax_vlog_level:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:221 TestBody Stream
1: TestVLog@2021-07-04 06:33:46.540590650 V:VLOG0:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:224 TestBody User Id 1
1: [ OK ] LoggingTestsFixture.TestVLog (0 ms)
1: [ RUN ] LoggingTestsFixture.TestTruncation
1: [ OK ] LoggingTestsFixture.TestTruncation (0 ms)
1: [ RUN ] LoggingTestsFixture.TestStreamMacroFromConditionalWithoutCompoundStatement
1: TestStreamMacroFromConditionalWithoutCompoundStatement@2021-07-04 06:33:46.540736917 V:onnxruntime:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:291 operator() true
1: TestStreamMacroFromConditionalWithoutCompoundStatement@2021-07-04 06:33:46.540760977 V:onnxruntime:/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/onnxruntime/test/common/logging/logging_test.cc:293 operator() false
1: [ OK ] LoggingTestsFixture.TestStreamMacroFromConditionalWithoutCompoundStatement (0 ms)
1: [----------] 8 tests from LoggingTestsFixture (1 ms total)
1:
1: [----------] 4 tests from LoggingTests
1: [ RUN ] LoggingTests.TestCLogSink
1: [ OK ] LoggingTests.TestCLogSink (0 ms)
1: [ RUN ] LoggingTests.TestCErrSink
1: [ OK ] LoggingTests.TestCErrSink (0 ms)
1: [ RUN ] LoggingTests.TestFileSink
1: [ OK ] LoggingTests.TestFileSink (0 ms)
1: [ RUN ] LoggingTests.TestCompositeSink
1: [ OK ] LoggingTests.TestCompositeSink (0 ms)
1: [----------] 4 tests from LoggingTests (0 ms total)
1:
1: [----------] 17 tests from PathTest
1: [ RUN ] PathTest.Parse
1: [ OK ] PathTest.Parse (0 ms)
1: [ RUN ] PathTest.ParseFailure
1: [ OK ] PathTest.ParseFailure (0 ms)
1: [ RUN ] PathTest.IsEmpty
1: [ OK ] PathTest.IsEmpty (0 ms)
1: [ RUN ] PathTest.IsAbsoluteOrRelative
1: [ OK ] PathTest.IsAbsoluteOrRelative (0 ms)
1: [ RUN ] PathTest.ParentPath
1: [ OK ] PathTest.ParentPath (0 ms)
1: [ RUN ] PathTest.Normalize
1: [ OK ] PathTest.Normalize (0 ms)
1: [ RUN ] PathTest.Append
1: [ OK ] PathTest.Append (0 ms)
1: [ RUN ] PathTest.RelativePath
1: [ OK ] PathTest.RelativePath (0 ms)
1: [ RUN ] PathTest.RelativePathFailure
1: [ OK ] PathTest.RelativePathFailure (0 ms)
1: [ RUN ] PathTest.Concat
1: [ OK ] PathTest.Concat (0 ms)
1: [ RUN ] PathTest.simple
1: [ OK ] PathTest.simple (0 ms)
1: [ RUN ] PathTest.trailing_slash
1: [ OK ] PathTest.trailing_slash (0 ms)
1: [ RUN ] PathTest.trailing_slash2
1: [ OK ] PathTest.trailing_slash2 (0 ms)
1: [ RUN ] PathTest.root
1: [ OK ] PathTest.root (0 ms)
1: [ RUN ] PathTest.single
1: [ OK ] PathTest.single (0 ms)
1: [ RUN ] PathTest.dot
1: [ OK ] PathTest.dot (0 ms)
1: [ RUN ] PathTest.dot_dot
1: [ OK ] PathTest.dot_dot (0 ms)
1: [----------] 17 tests from PathTest (0 ms total)
1:
1: [----------] 4 tests from StringUtilsTest
1: [ RUN ] StringUtilsTest.TryParseStringWithClassicLocale
1: [ OK ] StringUtilsTest.TryParseStringWithClassicLocale (0 ms)
1: [ RUN ] StringUtilsTest.TryParseStringAsString
1: [ OK ] StringUtilsTest.TryParseStringAsString (0 ms)
1: [ RUN ] StringUtilsTest.TryParseStringAsBool
1: [ OK ] StringUtilsTest.TryParseStringAsBool (0 ms)
1: [ RUN ] StringUtilsTest.MakeStringAndTryParseStringWithCustomType
1: [ OK ] StringUtilsTest.MakeStringAndTryParseStringWithCustomType (0 ms)
1: [----------] 4 tests from StringUtilsTest (0 ms total)
1:
1: [----------] 1 test from Utf8UtilTest
1: [ RUN ] Utf8UtilTest.Validate
1: [ OK ] Utf8UtilTest.Validate (0 ms)
1: [----------] 1 test from Utf8UtilTest (0 ms total)
1:
1: [----------] 1 test from RecordTest
1: [ RUN ] RecordTest.CommonDataStructureTest
1: [ OK ] RecordTest.CommonDataStructureTest (0 ms)
1: [----------] 1 test from RecordTest (0 ms total)
1:
1: [----------] 41 tests from GraphTest
1: [ RUN ] GraphTest.SimpleAddWithoutDomain
1: [ OK ] GraphTest.SimpleAddWithoutDomain (0 ms)
1: [ RUN ] GraphTest.SimpleAddDefaultDomain
1: [ OK ] GraphTest.SimpleAddDefaultDomain (0 ms)
1: [ RUN ] GraphTest.SimpleAddFutureOpSet
1: [ OK ] GraphTest.SimpleAddFutureOpSet (0 ms)
1: [ RUN ] GraphTest.SimpleAddONNXDomain
1: [ OK ] GraphTest.SimpleAddONNXDomain (0 ms)
1: [ RUN ] GraphTest.SimpleAddONNXDomain2
1: [ OK ] GraphTest.SimpleAddONNXDomain2 (0 ms)
1: [ RUN ] GraphTest.SimpleAddWrongDomain
1: [ OK ] GraphTest.SimpleAddWrongDomain (0 ms)
1: [ RUN ] GraphTest.SimpleAddWrongDomain2
1: [ OK ] GraphTest.SimpleAddWrongDomain2 (0 ms)
1: [ RUN ] GraphTest.SimpleUnique
1: [ OK ] GraphTest.SimpleUnique (0 ms)
1: [ RUN ] GraphTest.UnusedValueInfoSerializes
1: [ OK ] GraphTest.UnusedValueInfoSerializes (0 ms)
1: [ RUN ] GraphTest.WrongOpset
1: 2021-07-04 06:33:46.544918122 [W:onnxruntime:GraphTest, model.cc:139 Model] ONNX Runtime only *guarantees* support for models stamped with opset version 7 or above for opset domain 'ai.onnx'. Please upgrade your model to opset 7 or higher. For now, this opset 1 model may run depending upon legacy support of some older opset version operators.
1: [ OK ] GraphTest.WrongOpset (0 ms)
1: [ RUN ] GraphTest.ExtraInput
1: [ OK ] GraphTest.ExtraInput (0 ms)
1: [ RUN ] GraphTest.LocalCustomRegistry
1: [ OK ] GraphTest.LocalCustomRegistry (0 ms)
1: [ RUN ] GraphTest.FunctionOpsetImportTest
1: [ OK ] GraphTest.FunctionOpsetImportTest (1 ms)
1: [ RUN ] GraphTest.LocalCustomRegistryWrongOpsetImportVersion
1: [ OK ] GraphTest.LocalCustomRegistryWrongOpsetImportVersion (0 ms)
1: [ RUN ] GraphTest.ReverseDFS
1: [ OK ] GraphTest.ReverseDFS (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_VerifyNoDuplicateName
1: [ OK ] GraphTest.GraphConstruction_VerifyNoDuplicateName (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_VerifyNodeAndOpMatch
1: [ OK ] GraphTest.GraphConstruction_VerifyNodeAndOpMatch (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_CheckIsAcyclic
1: [ OK ] GraphTest.GraphConstruction_CheckIsAcyclic (1 ms)
1: [ RUN ] GraphTest.GraphConstruction_CheckInputNodeOrderMaintained
1: [ OK ] GraphTest.GraphConstruction_CheckInputNodeOrderMaintained (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_PriorityBasedTopologicalSort_CompressDecompress
1: [ OK ] GraphTest.GraphConstruction_PriorityBasedTopologicalSort_CompressDecompress (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_PriorityBasedTopologicalSort_CompressDecompress_Nested
1: [ OK ] GraphTest.GraphConstruction_PriorityBasedTopologicalSort_CompressDecompress_Nested (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_PriorityBasedTopologicalSort_Recompute
1: [ OK ] GraphTest.GraphConstruction_PriorityBasedTopologicalSort_Recompute (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_PriorityBasedTopologicalSort_MultiLayerRecompute
1: [ OK ] GraphTest.GraphConstruction_PriorityBasedTopologicalSort_MultiLayerRecompute (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_CheckGraphInputOutputOrderMaintained
1: [ OK ] GraphTest.GraphConstruction_CheckGraphInputOutputOrderMaintained (1 ms)
1: [ RUN ] GraphTest.UnusedInitializerIsIgnored
1: 2021-07-04 06:33:46.553221731 [W:onnxruntime:GraphTest, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'unused'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTest.UnusedInitializerIsIgnored (0 ms)
1: [ RUN ] GraphTest.UnusedSparseInitializerIsIgnored
1: 2021-07-04 06:33:46.553891877 [W:onnxruntime:GraphTest, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'unused_sparse_initializer'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTest.UnusedSparseInitializerIsIgnored (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_CheckIsNotAcyclic
1: [ OK ] GraphTest.GraphConstruction_CheckIsNotAcyclic (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_OnlyInitializer
1: 2021-07-04 06:33:46.554198427 [W:onnxruntime:GraphTest, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'node_1_in_2'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTest.GraphConstruction_OnlyInitializer (0 ms)
1: [ RUN ] GraphTest.GraphConstruction_TypeInference
1: [ OK ] GraphTest.GraphConstruction_TypeInference (0 ms)
1: [ RUN ] GraphTest.ShapeInferenceErrorHandling
1: [ OK ] GraphTest.ShapeInferenceErrorHandling (0 ms)
1: [ RUN ] GraphTest.AddTensorAttribute
1: [ OK ] GraphTest.AddTensorAttribute (0 ms)
1: [ RUN ] GraphTest.TypeAttribute
1: [ OK ] GraphTest.TypeAttribute (0 ms)
1: [ RUN ] GraphTest.VariadicOutput
1: [ OK ] GraphTest.VariadicOutput (0 ms)
1: [ RUN ] GraphTest.NonConstInitializer
1: 2021-07-04 06:33:46.556171277 [W:onnxruntime:GraphTest, graph.cc:1077 Graph] Initializer Y_Initializer appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: [ OK ] GraphTest.NonConstInitializer (0 ms)
1: [ RUN ] GraphTest.DuplicateName
1: [ OK ] GraphTest.DuplicateName (0 ms)
1: [ RUN ] GraphTest.ReplaceInitializedTensor
1: [ OK ] GraphTest.ReplaceInitializedTensor (0 ms)
1: [ RUN ] GraphTest.AddRemoveInitializerHandling
1: 2021-07-04 06:33:46.556716275 [W:onnxruntime:GraphTest, graph.cc:3222 CleanUnusedInitializers] Removing initializer '1'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.556734397 [W:onnxruntime:GraphTest, graph.cc:3222 CleanUnusedInitializers] Removing initializer '2'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTest.AddRemoveInitializerHandling (0 ms)
1: [ RUN ] GraphTest.SparseInitializerHandling
1: 2021-07-04 06:33:46.556987962 [W:onnxruntime:GraphTest, graph.cc:1077 Graph] Initializer x appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: [ OK ] GraphTest.SparseInitializerHandling (0 ms)
1: [ RUN ] GraphTest.SetInputsAndSetOutputs_NewInputAndOutput
1: [ OK ] GraphTest.SetInputsAndSetOutputs_NewInputAndOutput (0 ms)
1: [ RUN ] GraphTest.LoadModelMissingInput
1: [ OK ] GraphTest.LoadModelMissingInput (0 ms)
1: [ RUN ] GraphTest.DontRemoveUnusedInitializerWithGraphInput
1: 2021-07-04 06:33:46.557897515 [W:onnxruntime:GraphTest, graph.cc:1077 Graph] Initializer truncation:0 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: [ OK ] GraphTest.DontRemoveUnusedInitializerWithGraphInput (0 ms)
1: [----------] 41 tests from GraphTest (15 ms total)
1:
1: [----------] 1 test from GraphViewer
1: [ RUN ] GraphViewer.FilteredGraph
1: 2021-07-04 06:33:46.558911539 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer b appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.558935576 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer W appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.558956059 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer H appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.558974072 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer b_0 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.558991609 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer W_0 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559010217 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer H_0 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559027662 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer b_1 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559042903 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer W_1 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559058610 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer H_1 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559075587 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer b_2 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559092899 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer W_2 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559111593 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer H_2 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559129591 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer Constant13649PastValue16544 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559147227 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer Constant13649PastValue16566 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559165604 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer Constant14356PastValue16519 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559183423 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer Constant14356PastValue16541 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559201048 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer Constant15063PastValue16494 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559218767 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer Constant15063PastValue16516 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559236602 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer Constant15770PastValue16469 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.559254665 [W:onnxruntime:Default, graph.cc:1077 Graph] Initializer Constant15770PastValue16491 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: [ OK ] GraphViewer.FilteredGraph (11 ms)
1: [----------] 1 test from GraphViewer (11 ms total)
1:
1: [----------] 4 tests from ONNXModelsTest
1: [ RUN ] ONNXModelsTest.non_existing_model
1: [ OK ] ONNXModelsTest.non_existing_model (0 ms)
1: [ RUN ] ONNXModelsTest.future_opset
1: [ OK ] ONNXModelsTest.future_opset (0 ms)
1: [ RUN ] ONNXModelsTest.TestIRv4NonInputInitializers
1: [ OK ] ONNXModelsTest.TestIRv4NonInputInitializers (0 ms)
1: [ RUN ] ONNXModelsTest.TestModelsWithAnOpContainingAFunctionBody
1: [ OK ] ONNXModelsTest.TestModelsWithAnOpContainingAFunctionBody (3 ms)
1: [----------] 4 tests from ONNXModelsTest (4 ms total)
1:
1: [----------] 1 test from FormalParamTest
1: [ RUN ] FormalParamTest.Success
1: [ OK ] FormalParamTest.Success (0 ms)
1: [----------] 1 test from FormalParamTest (0 ms total)
1:
1: [----------] 1 test from FeatureVectorizerTest
1: [ RUN ] FeatureVectorizerTest.TraditionalMlOpTest
1: [ OK ] FeatureVectorizerTest.TraditionalMlOpTest (0 ms)
1: [----------] 1 test from FeatureVectorizerTest (0 ms total)
1:
1: [----------] 5 tests from OpRegistrationTest
1: [ RUN ] OpRegistrationTest.OpRegTest
1: [ OK ] OpRegistrationTest.OpRegTest (0 ms)
1: [ RUN ] OpRegistrationTest.TypeConstraintTest
1: [ OK ] OpRegistrationTest.TypeConstraintTest (0 ms)
1: [ RUN ] OpRegistrationTest.AttributeDefaultValueTest
1: [ OK ] OpRegistrationTest.AttributeDefaultValueTest (0 ms)
1: [ RUN ] OpRegistrationTest.AttributeDefaultValueListTest
1: [ OK ] OpRegistrationTest.AttributeDefaultValueListTest (0 ms)
1: [ RUN ] OpRegistrationTest.AffineOp
1: [ OK ] OpRegistrationTest.AffineOp (0 ms)
1: [----------] 5 tests from OpRegistrationTest (0 ms total)
1:
1: [----------] 1 test from OnnxRuntimeOpSchemaRegistry
1: [ RUN ] OnnxRuntimeOpSchemaRegistry.OpsetRegTest_WrongDomain
1: [ OK ] OnnxRuntimeOpSchemaRegistry.OpsetRegTest_WrongDomain (0 ms)
1: [----------] 1 test from OnnxRuntimeOpSchemaRegistry (0 ms total)
1:
1: [----------] 7 tests from SchemaRegistryManager
1: [ RUN ] SchemaRegistryManager.search_onnx_op
1: [ OK ] SchemaRegistryManager.search_onnx_op (0 ms)
1: [ RUN ] SchemaRegistryManager.search_memcpy_op
1: [ OK ] SchemaRegistryManager.search_memcpy_op (0 ms)
1: [ RUN ] SchemaRegistryManager.search_memcpy_op_wrong_version
1: [ OK ] SchemaRegistryManager.search_memcpy_op_wrong_version (0 ms)
1: [ RUN ] SchemaRegistryManager.search_onnxml_op
1: [ OK ] SchemaRegistryManager.search_onnxml_op (0 ms)
1: [ RUN ] SchemaRegistryManager.search_onnxml_op_wrong_opset_version
1: [ OK ] SchemaRegistryManager.search_onnxml_op_wrong_opset_version (0 ms)
1: [ RUN ] SchemaRegistryManager.search_custom_op_wrong_opset_version
1: [ OK ] SchemaRegistryManager.search_custom_op_wrong_opset_version (0 ms)
1: [ RUN ] SchemaRegistryManager.OpsetRegTest
1: [ OK ] SchemaRegistryManager.OpsetRegTest (0 ms)
1: [----------] 7 tests from SchemaRegistryManager (0 ms total)
1:
1: [----------] 1 test from OpUtilsTest
1: [ RUN ] OpUtilsTest.TestPTYPE
1: [ OK ] OpUtilsTest.TestPTYPE (0 ms)
1: [----------] 1 test from OpUtilsTest (0 ms total)
1:
1: [----------] 6 tests from GraphUtils
1: [ RUN ] GraphUtils.UpdateSubgraphWhenRemovingNode
1: [ OK ] GraphUtils.UpdateSubgraphWhenRemovingNode (1 ms)
1: [ RUN ] GraphUtils.UpdateNestedSubgraphWhenRemovingNode
1: [ OK ] GraphUtils.UpdateNestedSubgraphWhenRemovingNode (5 ms)
1: [ RUN ] GraphUtils.DontRemoveNodeIfItWillBreakSubgraph
1: 2021-07-04 06:33:46.584228040 [W:onnxruntime:Default, graph_utils.cc:121 CanUpdateImplicitInputNameInSubgraphs] Implicit input name outer_scope_0 cannot be safely updated to id_out_0 in one of the subgraphs.
1: [ OK ] GraphUtils.DontRemoveNodeIfItWillBreakSubgraph (1 ms)
1: [ RUN ] GraphUtils.DontRemoveNodeIfItWillBreakNestedSubgraph
1: 2021-07-04 06:33:46.589692628 [W:onnxruntime:Default, graph_utils.cc:121 CanUpdateImplicitInputNameInSubgraphs] Implicit input name outer_scope_0 cannot be safely updated to id_out_0 in one of the subgraphs.
1: [ OK ] GraphUtils.DontRemoveNodeIfItWillBreakNestedSubgraph (8 ms)
1: [ RUN ] GraphUtils.TestMultiEdgeRemovalNodes
1: [ OK ] GraphUtils.TestMultiEdgeRemovalNodes (0 ms)
1: [ RUN ] GraphUtils.TestMultiOutputRemoveNode
1: [ OK ] GraphUtils.TestMultiOutputRemoveNode (0 ms)
1: [----------] 6 tests from GraphUtils (18 ms total)
1:
1: [----------] 7 tests from CseTests
1: [ RUN ] CseTests.SimpleTest
1: [ OK ] CseTests.SimpleTest (0 ms)
1: [ RUN ] CseTests.GraphOutput
1: [ OK ] CseTests.GraphOutput (0 ms)
1: [ RUN ] CseTests.OptionalArgs
1: [ OK ] CseTests.OptionalArgs (0 ms)
1: [ RUN ] CseTests.Random
1: [ OK ] CseTests.Random (0 ms)
1: [ RUN ] CseTests.Subgraph
1: [ OK ] CseTests.Subgraph (1 ms)
1: [ RUN ] CseTests.MergedValueAndGraphOutputAreOutputsOfSameNode
1: [ OK ] CseTests.MergedValueAndGraphOutputAreOutputsOfSameNode (0 ms)
1: [ RUN ] CseTests.MergeConstants
1: [ OK ] CseTests.MergeConstants (16 ms)
1: [----------] 7 tests from CseTests (22 ms total)
1:
1: [----------] 1 test from FreeDimensionOverrideDenotationTransformerTest
1: [ RUN ] FreeDimensionOverrideDenotationTransformerTest.Test
1: [ OK ] FreeDimensionOverrideDenotationTransformerTest.Test (0 ms)
1: [----------] 1 test from FreeDimensionOverrideDenotationTransformerTest (0 ms total)
1:
1: [----------] 159 tests from GraphTransformationTests
1: [ RUN ] GraphTransformationTests.IdentityElimination
1: [ OK ] GraphTransformationTests.IdentityElimination (0 ms)
1: [ RUN ] GraphTransformationTests.IdentityEliminationWithGraphOutput
1: [ OK ] GraphTransformationTests.IdentityEliminationWithGraphOutput (0 ms)
1: [ RUN ] GraphTransformationTests.IdentityWithSharedNodeArgNotEliminated
1: [ OK ] GraphTransformationTests.IdentityWithSharedNodeArgNotEliminated (0 ms)
1: [ RUN ] GraphTransformationTests.IdentityInputIsGraphOutputNotEliminated
1: 2021-07-04 06:33:46.619379830 [W:onnxruntime:GraphTransformationTests, graph.cc:84 MergeShapeInfo] Error merging shape info for output. 'y' source:{2} target:{3,2}. Falling back to lenient merge.
1: [ OK ] GraphTransformationTests.IdentityInputIsGraphOutputNotEliminated (0 ms)
1: [ RUN ] GraphTransformationTests.NoopElimination
1: [ OK ] GraphTransformationTests.NoopElimination (1 ms)
1: [ RUN ] GraphTransformationTests.DropoutElimination
1: [ OK ] GraphTransformationTests.DropoutElimination (1 ms)
1: [ RUN ] GraphTransformationTests.SliceElimination
1: 2021-07-04 06:33:46.624324248 [W:onnxruntime:GraphTransformationTests, graph.cc:1077 Graph] Initializer endsG appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: [ OK ] GraphTransformationTests.SliceElimination (3 ms)
1: [ RUN ] GraphTransformationTests.ConstantFolding
1: [ OK ] GraphTransformationTests.ConstantFolding (2 ms)
1: [ RUN ] GraphTransformationTests.ConstantFoldingNodesOnDifferentEP
1: [ OK ] GraphTransformationTests.ConstantFoldingNodesOnDifferentEP (2 ms)
1: [ RUN ] GraphTransformationTests.ConstantFoldingSubgraph
1: 2021-07-04 06:33:46.632892217 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'local_constant'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.632994658 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'add_out'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.633038578 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'local_constant'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.633071280 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'add_out'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.ConstantFoldingSubgraph (1 ms)
1: [ RUN ] GraphTransformationTests.ConstantFoldingWithShapeToInitializer
1: [ OK ] GraphTransformationTests.ConstantFoldingWithShapeToInitializer (3 ms)
1: [ RUN ] GraphTransformationTests.ConstantFoldingWithScalarShapeToInitializer
1: [ OK ] GraphTransformationTests.ConstantFoldingWithScalarShapeToInitializer (0 ms)
1: [ RUN ] GraphTransformationTests.ConstantFoldingWithDequantizeLinear
1: 2021-07-04 06:33:46.638423281 [W:onnxruntime:Default, config_options.cc:38 AddConfigEntry] Config with key [session.disable_quant_qdq] already exists with value [0]. It will be overwritten
1: [ OK ] GraphTransformationTests.ConstantFoldingWithDequantizeLinear (1 ms)
1: [ RUN ] GraphTransformationTests.ConstantFolding_RemoveDanglingInputNodesToConstantFoldedNode
1: [ OK ] GraphTransformationTests.ConstantFolding_RemoveDanglingInputNodesToConstantFoldedNode (1 ms)
1: [ RUN ] GraphTransformationTests.ShapeToInitializer
1: [ OK ] GraphTransformationTests.ShapeToInitializer (0 ms)
1: [ RUN ] GraphTransformationTests.SubgraphWithConstantInputs
1: [ OK ] GraphTransformationTests.SubgraphWithConstantInputs (22 ms)
1: [ RUN ] GraphTransformationTests.FuseConvBNNoBias
1: [ OK ] GraphTransformationTests.FuseConvBNNoBias (1 ms)
1: [ RUN ] GraphTransformationTests.DontFuseConvWithBNWithOptionalOutputs
1: [ OK ] GraphTransformationTests.DontFuseConvWithBNWithOptionalOutputs (0 ms)
1: [ RUN ] GraphTransformationTests.FuseConvBNMulAddUnsqueeze
1: [ OK ] GraphTransformationTests.FuseConvBNMulAddUnsqueeze (6 ms)
1: [ RUN ] GraphTransformationTests.DivMulFusion
1: [ OK ] GraphTransformationTests.DivMulFusion (1 ms)
1: [ RUN ] GraphTransformationTests.NotWhereFusion
1: [ OK ] GraphTransformationTests.NotWhereFusion (1 ms)
1: [ RUN ] GraphTransformationTests.FuseCudaConvAddRelu
1: [ OK ] GraphTransformationTests.FuseCudaConvAddRelu (0 ms)
1: [ RUN ] GraphTransformationTests.FuseCudaConvAddReluIdentity
1: [ OK ] GraphTransformationTests.FuseCudaConvAddReluIdentity (0 ms)
1: [ RUN ] GraphTransformationTests.FuseCudaConvAdd
1: [ OK ] GraphTransformationTests.FuseCudaConvAdd (0 ms)
1: [ RUN ] GraphTransformationTests.FuseConvActivation
1: [ OK ] GraphTransformationTests.FuseConvActivation (0 ms)
1: [ RUN ] GraphTransformationTests.FuseConvClip11Activation
1: [ OK ] GraphTransformationTests.FuseConvClip11Activation (1 ms)
1: [ RUN ] GraphTransformationTests.FuseConvMulNoBias
1: [ OK ] GraphTransformationTests.FuseConvMulNoBias (0 ms)
1: [ RUN ] GraphTransformationTests.FuseConvAddNoBias
1: [ OK ] GraphTransformationTests.FuseConvAddNoBias (0 ms)
1: [ RUN ] GraphTransformationTests.NegativeFuseConvAddNoBias
1: 2021-07-04 06:33:46.681083814 [W:onnxruntime:GraphTransformationTests, graph.cc:1077 Graph] Initializer conv1/bn_b_0 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: 2021-07-04 06:33:46.681109036 [W:onnxruntime:GraphTransformationTests, graph.cc:1077 Graph] Initializer conv1_w_0 appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: [ OK ] GraphTransformationTests.NegativeFuseConvAddNoBias (0 ms)
1: [ RUN ] GraphTransformationTests.FuseConvAddMul3D
1: [ OK ] GraphTransformationTests.FuseConvAddMul3D (2 ms)
1: [ RUN ] GraphTransformationTests.FuseConvAddMul1D
1: [ OK ] GraphTransformationTests.FuseConvAddMul1D (2 ms)
1: [ RUN ] GraphTransformationTests.FuseConvAddMul3D_2
1: [ OK ] GraphTransformationTests.FuseConvAddMul3D_2 (2 ms)
1: [ RUN ] GraphTransformationTests.FuseConvAddMul1D_2
1: [ OK ] GraphTransformationTests.FuseConvAddMul1D_2 (2 ms)
1: [ RUN ] GraphTransformationTests.MatMulAddFusion_two_input
1: [ OK ] GraphTransformationTests.MatMulAddFusion_two_input (0 ms)
1: [ RUN ] GraphTransformationTests.MatMulAddFusion_three_input
1: [ OK ] GraphTransformationTests.MatMulAddFusion_three_input (0 ms)
1: [ RUN ] GraphTransformationTests.MatMulAddFusion_negitive_case
1: [ OK ] GraphTransformationTests.MatMulAddFusion_negitive_case (0 ms)
1: [ RUN ] GraphTransformationTests.MatMulAddFusion_NotBroadcastable
1: [ OK ] GraphTransformationTests.MatMulAddFusion_NotBroadcastable (0 ms)
1: [ RUN ] GraphTransformationTests.MatMulAddFusion_MissingShape
1: [ OK ] GraphTransformationTests.MatMulAddFusion_MissingShape (0 ms)
1: [ RUN ] GraphTransformationTests.Gemm_Relu_three_input
1: [ OK ] GraphTransformationTests.Gemm_Relu_three_input (0 ms)
1: [ RUN ] GraphTransformationTests.TransposeMatmulFusion
1: [ OK ] GraphTransformationTests.TransposeMatmulFusion (0 ms)
1: [ RUN ] GraphTransformationTests.TransposeCastMatmulFusion
1: [ OK ] GraphTransformationTests.TransposeCastMatmulFusion (7 ms)
1: [ RUN ] GraphTransformationTests.TransposeMatmulFusionOnTwoTranspose
1: [ OK ] GraphTransformationTests.TransposeMatmulFusionOnTwoTranspose (0 ms)
1: [ RUN ] GraphTransformationTests.TransposeMatmulFusionOnThreeTranspose
1: [ OK ] GraphTransformationTests.TransposeMatmulFusionOnThreeTranspose (0 ms)
1: [ RUN ] GraphTransformationTests.TransposeMatmulNoFusionOnInvalidInput
1: [ OK ] GraphTransformationTests.TransposeMatmulNoFusionOnInvalidInput (1 ms)
1: [ RUN ] GraphTransformationTests.TransposeMatmulFusionFromTransposeMatMul
1: [ OK ] GraphTransformationTests.TransposeMatmulFusionFromTransposeMatMul (0 ms)
1: [ RUN ] GraphTransformationTests.TransposeMatmulFusionWithPreservedTranspose
1: [ OK ] GraphTransformationTests.TransposeMatmulFusionWithPreservedTranspose (0 ms)
1: [ RUN ] GraphTransformationTests.Gemm_LeakyRelu_Fusion
1: [ OK ] GraphTransformationTests.Gemm_LeakyRelu_Fusion (0 ms)
1: [ RUN ] GraphTransformationTests.GemmTransposeFusion2Inputs
1: [ OK ] GraphTransformationTests.GemmTransposeFusion2Inputs (0 ms)
1: [ RUN ] GraphTransformationTests.GemmTransposeFusionOutput
1: [ OK ] GraphTransformationTests.GemmTransposeFusionOutput (0 ms)
1: [ RUN ] GraphTransformationTests.GemmTransposeFusionInputOutput
1: [ OK ] GraphTransformationTests.GemmTransposeFusionInputOutput (0 ms)
1: [ RUN ] GraphTransformationTests.FuseConvBnAddMulFloat16
1: [ OK ] GraphTransformationTests.FuseConvBnAddMulFloat16 (8 ms)
1: [ RUN ] GraphTransformationTests.ReluClip6Fusion
1: [ OK ] GraphTransformationTests.ReluClip6Fusion (0 ms)
1: [ RUN ] GraphTransformationTests.ReluClip11Fusion
1: [ OK ] GraphTransformationTests.ReluClip11Fusion (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionTest
1: [ OK ] GraphTransformationTests.ReshapeFusionTest (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionOneConstTest
1: [ OK ] GraphTransformationTests.ReshapeFusionOneConstTest (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionInternalNodeIsOutput
1: [ OK ] GraphTransformationTests.ReshapeFusionInternalNodeIsOutput (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionInternalReuseTest
1: [ OK ] GraphTransformationTests.ReshapeFusionInternalReuseTest (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionGraphInputsTest
1: [ OK ] GraphTransformationTests.ReshapeFusionGraphInputsTest (0 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionMultipleValuesInInitializerSubgraphTest
1: [ OK ] GraphTransformationTests.ReshapeFusionMultipleValuesInInitializerSubgraphTest (0 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionMultipleValuesInInitializerAppliesTest
1: [ OK ] GraphTransformationTests.ReshapeFusionMultipleValuesInInitializerAppliesTest (0 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionAnotherGraphInput
1: [ OK ] GraphTransformationTests.ReshapeFusionAnotherGraphInput (0 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionOverridableInitializer
1: 2021-07-04 06:33:46.725544950 [W:onnxruntime:GraphTransformationTests, graph.cc:1077 Graph] Initializer a appears in graph inputs and will not be treated as constant value/weight. This may prevent some of the graph optimizations, like const folding. Move it out of graph inputs if there is no need to override it, by either re-generating the model with latest exporter/converter or with the tool onnxruntime/tools/python/remove_initializer_from_input.py.
1: [ OK ] GraphTransformationTests.ReshapeFusionOverridableInitializer (0 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionConcatSubgraphMultipleOutputs
1: [ OK ] GraphTransformationTests.ReshapeFusionConcatSubgraphMultipleOutputs (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionConcatSubgraph
1: [ OK ] GraphTransformationTests.ReshapeFusionConcatSubgraph (0 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionWithSlice1
1: [ OK ] GraphTransformationTests.ReshapeFusionWithSlice1 (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionConcatSubgraphNotTriggered
1: [ OK ] GraphTransformationTests.ReshapeFusionConcatSubgraphNotTriggered (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionConcatSubgraphWithDiv
1: [ OK ] GraphTransformationTests.ReshapeFusionConcatSubgraphWithDiv (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionConcatSubgraphWithMul
1: [ OK ] GraphTransformationTests.ReshapeFusionConcatSubgraphWithMul (1 ms)
1: [ RUN ] GraphTransformationTests.ReshapeFusionDistilBertTest
1: [ OK ] GraphTransformationTests.ReshapeFusionDistilBertTest (1 ms)
1: [ RUN ] GraphTransformationTests.ConcatSliceEliminationTest
1: [ OK ] GraphTransformationTests.ConcatSliceEliminationTest (1 ms)
1: [ RUN ] GraphTransformationTests.ExpandElimination
1: [ OK ] GraphTransformationTests.ExpandElimination (1 ms)
1: [ RUN ] GraphTransformationTests.CastElimination
1: [ OK ] GraphTransformationTests.CastElimination (1 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionInt32Test
1: 2021-07-04 06:33:46.740792206 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '449'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.740815755 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '444'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.740824734 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '447'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.740832237 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '448'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.740838903 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '443'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.740846426 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '445'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.740854305 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '446'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.AttentionFusionInt32Test (2 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionInt64Test
1: 2021-07-04 06:33:46.743770743 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '449'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.743790985 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '444'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.743799722 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '447'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.743807219 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '448'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.743814758 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '443'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.743822371 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '445'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.743830809 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer '446'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.AttentionFusionInt64Test (3 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionFloat32Test
1: [ OK ] GraphTransformationTests.AttentionFusionFloat32Test (2 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionWithPastAndUnidirMaskTest
1: [ OK ] GraphTransformationTests.AttentionFusionWithPastAndUnidirMaskTest (10 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionWithPastAndNoUnidirMaskTest
1: [ OK ] GraphTransformationTests.AttentionFusionWithPastAndNoUnidirMaskTest (11 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionGPTWithPastAndMaskTest
1: [ OK ] GraphTransformationTests.AttentionFusionGPTWithPastAndMaskTest (11 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionGPTWithPastNoMaskTest
1: [ OK ] GraphTransformationTests.AttentionFusionGPTWithPastNoMaskTest (11 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionGPTTest
1: [ OK ] GraphTransformationTests.AttentionFusionGPTTest (10 ms)
1: [ RUN ] GraphTransformationTests.AttentionFusionDistilBertTest
1: 2021-07-04 06:33:46.806315654 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'reshape_weight_3'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:46.806336276 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'reshape_weight_2'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.AttentionFusionDistilBertTest (3 ms)
1: [ RUN ] GraphTransformationTests.GeluFusionTest
1: [ OK ] GraphTransformationTests.GeluFusionTest (0 ms)
1: [ RUN ] GraphTransformationTests.GeluFusionTestSwitchOrderFormat2
1: [ OK ] GraphTransformationTests.GeluFusionTestSwitchOrderFormat2 (0 ms)
1: [ RUN ] GraphTransformationTests.GeluFusionTestFormat2
1: [ OK ] GraphTransformationTests.GeluFusionTestFormat2 (0 ms)
1: [ RUN ] GraphTransformationTests.GeluFusionTestFormat2GraphInput
1: [ OK ] GraphTransformationTests.GeluFusionTestFormat2GraphInput (0 ms)
1: [ RUN ] GraphTransformationTests.GeluFusionTestFormat2GraphOutput
1: [ OK ] GraphTransformationTests.GeluFusionTestFormat2GraphOutput (0 ms)
1: [ RUN ] GraphTransformationTests.BiasGeluTest
1: [ OK ] GraphTransformationTests.BiasGeluTest (0 ms)
1: [ RUN ] GraphTransformationTests.BiasGeluSwitchedInputOrder
1: [ OK ] GraphTransformationTests.BiasGeluSwitchedInputOrder (336 ms)
1: [ RUN ] GraphTransformationTests.GeluApproximation_SessionOptionConfig
1: 2021-07-04 06:33:47.148779354 [W:onnxruntime:Default, config_options.cc:38 AddConfigEntry] Config with key [optimization.enable_gelu_approximation] already exists with value [1]. It will be overwritten
1: [ OK ] GraphTransformationTests.GeluApproximation_SessionOptionConfig (0 ms)
1: [ RUN ] GraphTransformationTests.GeluApproximation_Gelu
1: [ OK ] GraphTransformationTests.GeluApproximation_Gelu (0 ms)
1: [ RUN ] GraphTransformationTests.GeluApproximation_Gelu_Add_Bias
1: [ OK ] GraphTransformationTests.GeluApproximation_Gelu_Add_Bias (0 ms)
1: [ RUN ] GraphTransformationTests.GeluApproximation_Gelu_Add_MatMul
1: [ OK ] GraphTransformationTests.GeluApproximation_Gelu_Add_MatMul (0 ms)
1: [ RUN ] GraphTransformationTests.FastGeluFusionTest
1: [ OK ] GraphTransformationTests.FastGeluFusionTest (1 ms)
1: [ RUN ] GraphTransformationTests.FastGeluUseGraphInputFusionTest
1: [ OK ] GraphTransformationTests.FastGeluUseGraphInputFusionTest (1 ms)
1: [ RUN ] GraphTransformationTests.FastGeluWithBiasFusionTest
1: [ OK ] GraphTransformationTests.FastGeluWithBiasFusionTest (1 ms)
1: [ RUN ] GraphTransformationTests.FastGeluWithBiasUseGraphInputFusionTest
1: [ OK ] GraphTransformationTests.FastGeluWithBiasUseGraphInputFusionTest (1 ms)
1: [ RUN ] GraphTransformationTests.FastGeluFusionTest2
1: [ OK ] GraphTransformationTests.FastGeluFusionTest2 (1 ms)
1: [ RUN ] GraphTransformationTests.FastGeluUseGraphInputFusionTest2
1: [ OK ] GraphTransformationTests.FastGeluUseGraphInputFusionTest2 (0 ms)
1: [ RUN ] GraphTransformationTests.FastGeluWithBiasFusionTest2
1: [ OK ] GraphTransformationTests.FastGeluWithBiasFusionTest2 (1 ms)
1: [ RUN ] GraphTransformationTests.FastGeluWithBiasUseGraphInputFusionTest2
1: [ OK ] GraphTransformationTests.FastGeluWithBiasUseGraphInputFusionTest2 (1 ms)
1: [ RUN ] GraphTransformationTests.FastGeluFusionWithCastsTest3
1: [ OK ] GraphTransformationTests.FastGeluFusionWithCastsTest3 (2 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_GpuOnly
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_GpuOnly (0 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_Simple_Rocm
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_Simple_Rocm (0 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_Simple_Cuda
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_Simple_Cuda (0 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_MiddleOnes
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_MiddleOnes (0 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_ReversedInputs
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_ReversedInputs (0 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_BadAxis
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_BadAxis (0 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_AllLeadingOnes
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_AllLeadingOnes (0 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_SomeLeadingOnes
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_SomeLeadingOnes (0 ms)
1: [ RUN ] GraphTransformationTests.BiasSoftmaxFusionTest_NoLeadingOnes
1: [ OK ] GraphTransformationTests.BiasSoftmaxFusionTest_NoLeadingOnes (0 ms)
1: [ RUN ] GraphTransformationTests.BiasDropoutFusionTest
1: [ OK ] GraphTransformationTests.BiasDropoutFusionTest (3 ms)
1: [ RUN ] GraphTransformationTests.LayerNormFusionTest
1: [ OK ] GraphTransformationTests.LayerNormFusionTest (1 ms)
1: [ RUN ] GraphTransformationTests.LayerNormWithCastFusionTest
1: [ OK ] GraphTransformationTests.LayerNormWithCastFusionTest (0 ms)
1: [ RUN ] GraphTransformationTests.LayerNormWithCastFusionTest_2
1: [ OK ] GraphTransformationTests.LayerNormWithCastFusionTest_2 (1 ms)
1: [ RUN ] GraphTransformationTests.LayerNormWithSubDupFusionTest
1: [ OK ] GraphTransformationTests.LayerNormWithSubDupFusionTest (1 ms)
1: [ RUN ] GraphTransformationTests.SimplifiedLayerNormFusionTest
1: [ OK ] GraphTransformationTests.SimplifiedLayerNormFusionTest (0 ms)
1: [ RUN ] GraphTransformationTests.SimplifiedLayerNormWithCastsFusionTest_PrecisionChangeDisallowed
1: [ OK ] GraphTransformationTests.SimplifiedLayerNormWithCastsFusionTest_PrecisionChangeDisallowed (0 ms)
1: [ RUN ] GraphTransformationTests.SimplifiedLayerNormWithCastsFusionTest_PrecisionChangeAllowed
1: [ OK ] GraphTransformationTests.SimplifiedLayerNormWithCastsFusionTest_PrecisionChangeAllowed (0 ms)
1: [ RUN ] GraphTransformationTests.SkipLayerNormFusionTest
1: [ OK ] GraphTransformationTests.SkipLayerNormFusionTest (14 ms)
1: [ RUN ] GraphTransformationTests.SkipLayerNormFusion_Input_Output_Check
1: [ OK ] GraphTransformationTests.SkipLayerNormFusion_Input_Output_Check (1 ms)
1: [ RUN ] GraphTransformationTests.SkipLayerNormFusion_NoBeta
1: [ OK ] GraphTransformationTests.SkipLayerNormFusion_NoBeta (0 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat1
1: 2021-07-04 06:33:47.194769370 [W:onnxruntime:GraphTransformationTests, graph.cc:84 MergeShapeInfo] Error merging shape info for output. 'output' source:{2,3,3} target:{2,3,1}. Falling back to lenient merge.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat1 (1 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat2
1: 2021-07-04 06:33:47.196989052 [W:onnxruntime:GraphTransformationTests, graph.cc:84 MergeShapeInfo] Error merging shape info for output. 'output' source:{2,3,3} target:{2,3,1}. Falling back to lenient merge.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat2 (1 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat3
1: 2021-07-04 06:33:47.199698183 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_1'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.199713680 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat3 (3 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat3_OpSet13
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat3_OpSet13 (5 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat3NoCast
1: 2021-07-04 06:33:47.209173269 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_1'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.209192101 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat3NoCast (3 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat3NoCast_OpSet13
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat3NoCast_OpSet13 (4 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat4
1: 2021-07-04 06:33:47.217190339 [W:onnxruntime:GraphTransformationTests, graph.cc:84 MergeShapeInfo] Error merging shape info for output. 'output' source:{2,3,3} target:{2,3,1}. Falling back to lenient merge.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat4 (2 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat5
1: 2021-07-04 06:33:47.218408177 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_1'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat5 (1 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat5_OpSet13
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat5_OpSet13 (3 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat6
1: 2021-07-04 06:33:47.225241223 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_1'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.225258417 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat6 (3 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat6_OpSet13
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat6_OpSet13 (5 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat7
1: 2021-07-04 06:33:47.233733000 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_1'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.233754335 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_0'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.233767091 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'indices_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat7 (3 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat7_OpSet13
1: 2021-07-04 06:33:47.238893009 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'indices_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat7_OpSet13 (4 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat8
1: 2021-07-04 06:33:47.242011538 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_1'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.242026476 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_0'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.242035225 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'indices_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat8 (2 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat8_OpSet13
1: 2021-07-04 06:33:47.246388925 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'indices_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat8_OpSet13 (4 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat9
1: 2021-07-04 06:33:47.249735038 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_1'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.249750472 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat9 (3 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionFormat9_OpSet13
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionFormat9_OpSet13 (4 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionMultiple
1: 2021-07-04 06:33:47.260490909 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_1'. It is not used by any node and should be removed from the model.
1: 2021-07-04 06:33:47.260507487 [W:onnxruntime:GraphTransformationTests, graph.cc:3222 CleanUnusedInitializers] Removing initializer 'axes_0'. It is not used by any node and should be removed from the model.
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionMultiple (6 ms)
1: [ RUN ] GraphTransformationTests.EmbedLayerNormFusionMultiple_OpSet13
1: [ OK ] GraphTransformationTests.EmbedLayerNormFusionMultiple_OpSet13 (9 ms)
1: [ RUN ] GraphTransformationTests.DynamicQuantizeMatMulTest
1: [ OK ] GraphTransformationTests.DynamicQuantizeMatMulTest (2 ms)
1: [ RUN ] GraphTransformationTests.DynamicQuantizeMatMulTest_With_Bias
1: [ OK ] GraphTransformationTests.DynamicQuantizeMatMulTest_With_Bias (2 ms)
1: [ RUN ] GraphTransformationTests.DynamicQuantizeMatMulTest_With_ND_bias
1: [ OK ] GraphTransformationTests.DynamicQuantizeMatMulTest_With_ND_bias (2 ms)
1: [ RUN ] GraphTransformationTests.DynamicQuantizeMatMulTest_With_Bias_No_B_ZP
1: [ OK ] GraphTransformationTests.DynamicQuantizeMatMulTest_With_Bias_No_B_ZP (2 ms)
1: [ RUN ] GraphTransformationTests.MatMulIntegerToFloatTest
1: [ OK ] GraphTransformationTests.MatMulIntegerToFloatTest (2 ms)
1: [ RUN ] GraphTransformationTests.ComputationReductionTransformer_GatherND_Gelu
1: 2021-07-04 06:33:47.285088915 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node gelu_1
1:
1: [ OK ] GraphTransformationTests.ComputationReductionTransformer_GatherND_Gelu (0 ms)
1: [ RUN ] GraphTransformationTests.ComputationReductionTransformer_GatherND_Add
1: 2021-07-04 06:33:47.285717613 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_2 up across node add_2
1:
1: 2021-07-04 06:33:47.285751151 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node add_1
1:
1: [ OK ] GraphTransformationTests.ComputationReductionTransformer_GatherND_Add (0 ms)
1: [ RUN ] GraphTransformationTests.ComputationReductionTransformer_GatherND_LayerNormalization
1: 2021-07-04 06:33:47.286595243 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node layer_norm_1
1:
1: [ OK ] GraphTransformationTests.ComputationReductionTransformer_GatherND_LayerNormalization (0 ms)
1: [ RUN ] GraphTransformationTests.ComputationReductionTransformer_GatherND_MatMul
1: 2021-07-04 06:33:47.287170735 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node matmul_1
1:
1: [ OK ] GraphTransformationTests.ComputationReductionTransformer_GatherND_MatMul (0 ms)
1: [ RUN ] GraphTransformationTests.ComputationReductionTransformer_GatherND_E2E
1: 2021-07-04 06:33:47.288839210 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node add_2
1:
1: 2021-07-04 06:33:47.288875548 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node matmul_2
1:
1: 2021-07-04 06:33:47.288906597 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node layer_norm_2
1:
1: 2021-07-04 06:33:47.288936360 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node gelu_1
1:
1: 2021-07-04 06:33:47.288966372 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node add_1
1:
1: 2021-07-04 06:33:47.288997050 [W:onnxruntime:Default, computation_reduction.cc:283 ApplyImpl] node gathernd_1 up across node matmul_1
1:
1: 2021-07-04 06:33:47.289008304 [W:onnxruntime:Default, computation_reduction.cc:276 ApplyImpl] node gathernd_1 stopped at node layer_norm_1
1: 2021-07-04 06:33:47.289514467 [W:onnxruntime:Default, computation_reduction.cc:276 ApplyImpl] node gathernd_1 stopped at node layer_norm_1
1/3 Test #1: onnxruntime_test_all .............***Exception: SegFault 13.97 sec
test 2
Start 2: onnx_test_pytorch_converted
2: Test command: /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/onnx_test_runner "/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/cmake/external/onnx/onnx/backend/test/data/pytorch-converted"
2: Test timeout computed to be: 7200
2: 2021-07-04 06:34:00.496652436 [E:onnxruntime:Default, testcase_driver.cc:39 RunParallel] Running tests in parallel: at most 16 models at any time
2: 2021-07-04 06:34:01.116581206 [E:onnxruntime:Default, testcase_driver.cc:61 RunModelsAsync] Running tests finished. Generating report
2: result:
2: Models: 59
2: Total test cases: 59
2: Succeeded: 59
2: Not implemented: 0
2: Failed: 0
2: Stats by Operator type:
2: Not implemented(0):
2: Failed:
2: Failed Test Cases:
2/3 Test #2: onnx_test_pytorch_converted ...... Passed 0.70 sec
test 3
Start 3: onnx_test_pytorch_operator
3: Test command: /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/onnx_test_runner "/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/cmake/external/onnx/onnx/backend/test/data/pytorch-operator"
3: Test timeout computed to be: 7200
3: 2021-07-04 06:34:01.182239822 [E:onnxruntime:Default, testcase_driver.cc:39 RunParallel] Running tests in parallel: at most 16 models at any time
3: 2021-07-04 06:34:01.504757172 [E:onnxruntime:Default, testcase_driver.cc:61 RunModelsAsync] Running tests finished. Generating report
3: result:
3: Models: 24
3: Total test cases: 24
3: Succeeded: 24
3: Not implemented: 0
3: Failed: 0
3: Stats by Operator type:
3: Not implemented(0):
3: Failed:
3: Failed Test Cases:
3/3 Test #3: onnx_test_pytorch_operator ....... Passed 0.39 sec
67% tests passed, 1 tests failed out of 3
Total Test time (real) = 15.06 sec
The following tests FAILED:
1 - onnxruntime_test_all (SEGFAULT)
Errors while running CTest
Traceback (most recent call last):
File "/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/tools/ci_build/build.py", line 2199, in <module>
sys.exit(main())
File "/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/tools/ci_build/build.py", line 2126, in main
run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs)
File "/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/tools/ci_build/build.py", line 1475, in run_onnxruntime_tests
run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path)
File "/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/tools/ci_build/build.py", line 593, in run_subprocess
return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env)
File "/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/tools/python/util/run.py", line 44, in run
env=env, shell=shell)
File "/home/alphabin/anaconda3/lib/python3.7/subprocess.py", line 487, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['/usr/bin/ctest', '--build-config', 'Debug', '--verbose', '--timeout', '7200']' returned non-zero exit status 8.
If I use "--skip_test" when building, the "Segmentation fault (core dumped)" problem still appears when creating session.
ort_session = onnxruntime.InferenceSession(save_name)
Could you help me to solve it? Thanks.
To provide more useful information, I posted the detailed log printed before the build process here.
2021-07-04 07:25:49,130 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available
2021-07-04 07:25:49,159 build [DEBUG] - Defaulting to running update, build [and test for native builds].
2021-07-04 07:25:49,160 build [INFO] - Build started
2021-07-04 07:25:49,161 util.run [INFO] - Running subprocess in '/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime'
['git', 'submodule', 'sync', '--recursive']
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary'
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary/src/3rdParty/eigen'
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary/src/3rdParty/re2'
Synchronizing submodule url for 'cmake/external/SafeInt/safeint'
Synchronizing submodule url for 'cmake/external/coremltools'
Synchronizing submodule url for 'cmake/external/cub'
Synchronizing submodule url for 'cmake/external/cxxopts'
Synchronizing submodule url for 'cmake/external/date'
Synchronizing submodule url for 'cmake/external/dlpack'
Synchronizing submodule url for 'cmake/external/eigen'
Synchronizing submodule url for 'cmake/external/emsdk'
Synchronizing submodule url for 'cmake/external/flatbuffers'
Synchronizing submodule url for 'cmake/external/googlebenchmark'
Synchronizing submodule url for 'cmake/external/googletest'
Synchronizing submodule url for 'cmake/external/json'
Synchronizing submodule url for 'cmake/external/libprotobuf-mutator'
Synchronizing submodule url for 'cmake/external/mimalloc'
Synchronizing submodule url for 'cmake/external/mp11'
Synchronizing submodule url for 'cmake/external/nsync'
Synchronizing submodule url for 'cmake/external/onnx'
Synchronizing submodule url for 'cmake/external/onnx/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/onnx/third_party/pybind11'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang'
Synchronizing submodule url for 'cmake/external/onnxruntime-extensions'
Synchronizing submodule url for 'cmake/external/optional-lite'
Synchronizing submodule url for 'cmake/external/protobuf'
Synchronizing submodule url for 'cmake/external/protobuf/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/protobuf/third_party/googletest'
Synchronizing submodule url for 'cmake/external/re2'
Synchronizing submodule url for 'cmake/external/tensorboard'
Synchronizing submodule url for 'cmake/external/tvm'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/HalideIR'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/dlpack'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/dmlc-core'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/rang'
Synchronizing submodule url for 'cmake/external/wil'
Synchronizing submodule url for 'server/external/spdlog'
2021-07-04 07:25:49,690 util.run [DEBUG] - Subprocess completed. Return code: 0
2021-07-04 07:25:49,690 util.run [INFO] - Running subprocess in '/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime'
['git', 'submodule', 'update', '--init', '--recursive']
2021-07-04 07:25:50,367 util.run [DEBUG] - Subprocess completed. Return code: 0
2021-07-04 07:25:50,368 util.run [INFO] - Running subprocess in '/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime'
['/home/alphabin/anaconda3/bin/python3', '-m', 'pip', 'install', 'setuptools', 'wheel', 'pytest', 'numpy>=1.16.6', 'sympy>=1.1', 'packaging', 'cerberus']
Requirement already satisfied: setuptools in /home/alphabin/anaconda3/lib/python3.7/site-packages (41.4.0)
Requirement already satisfied: wheel in /home/alphabin/anaconda3/lib/python3.7/site-packages (0.33.6)
Requirement already satisfied: pytest in /home/alphabin/anaconda3/lib/python3.7/site-packages (5.2.1)
Requirement already satisfied: numpy>=1.16.6 in /home/alphabin/anaconda3/lib/python3.7/site-packages (1.17.2)
Requirement already satisfied: sympy>=1.1 in /home/alphabin/anaconda3/lib/python3.7/site-packages (1.4)
Requirement already satisfied: packaging in /home/alphabin/anaconda3/lib/python3.7/site-packages (19.2)
Collecting cerberus
Using cached https://files.pythonhosted.org/packages/c4/87/55f8b2e36a5f97c5aaf6424e75f7a21cbd69d0365f6e2e332d03d029bb15/Cerberus-1.3.4.tar.gz
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing wheel metadata ... done
Requirement already satisfied: py>=1.5.0 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from pytest) (1.8.0)
Requirement already satisfied: attrs>=17.4.0 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from pytest) (19.2.0)
Requirement already satisfied: more-itertools>=4.0.0 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from pytest) (7.2.0)
Requirement already satisfied: atomicwrites>=1.0 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from pytest) (1.3.0)
Requirement already satisfied: pluggy<1.0,>=0.12 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from pytest) (0.13.0)
Requirement already satisfied: wcwidth in /home/alphabin/anaconda3/lib/python3.7/site-packages (from pytest) (0.1.7)
Requirement already satisfied: importlib-metadata>=0.12 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from pytest) (0.23)
Requirement already satisfied: mpmath>=0.19 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from sympy>=1.1) (1.1.0)
Requirement already satisfied: pyparsing>=2.0.2 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from packaging) (2.4.2)
Requirement already satisfied: six in /home/alphabin/anaconda3/lib/python3.7/site-packages (from packaging) (1.12.0)
Requirement already satisfied: zipp>=0.5 in /home/alphabin/anaconda3/lib/python3.7/site-packages (from importlib-metadata>=0.12->pytest) (0.6.0)
Building wheels for collected packages: cerberus
Building wheel for cerberus (PEP 517) ... done
Created wheel for cerberus: filename=Cerberus-1.3.4-cp37-none-any.whl size=58196 sha256=59ae3326e2b90ee973846144da7d271324d95da7a6698eb23a7157aad031a151
Stored in directory: /home/alphabin/.cache/pip/wheels/77/71/3b/c25a33072e89278d7b0e814f61a083a881cdcf0df8a932b66b
Successfully built cerberus
Installing collected packages: cerberus
Successfully installed cerberus-1.3.4
2021-07-04 07:25:59,808 util.run [DEBUG] - Subprocess completed. Return code: 0
2021-07-04 07:25:59,808 build [INFO] - Generating CMake build tree
2021-07-04 07:25:59,809 util.run [INFO] - Running subprocess in '/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug'
['/usr/bin/cmake', '/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/cmake', '-Donnxruntime_RUN_ONNX_TESTS=OFF', '-Donnxruntime_BUILD_WINML_TESTS=ON', '-Donnxruntime_GENERATE_TEST_REPORTS=ON', '-Donnxruntime_DEV_MODE=ON', '-DPython_EXECUTABLE=/home/alphabin/anaconda3/bin/python3', '-DPYTHON_EXECUTABLE=/home/alphabin/anaconda3/bin/python3', '-Donnxruntime_ROCM_VERSION=', '-Donnxruntime_USE_FEATURIZERS=OFF', '-Donnxruntime_USE_MIMALLOC_STL_ALLOCATOR=OFF', '-Donnxruntime_USE_MIMALLOC_ARENA_ALLOCATOR=OFF', '-Donnxruntime_ENABLE_PYTHON=ON', '-Donnxruntime_BUILD_CSHARP=OFF', '-Donnxruntime_BUILD_JAVA=OFF', '-Donnxruntime_BUILD_NODEJS=OFF', '-Donnxruntime_BUILD_OBJC=OFF', '-Donnxruntime_BUILD_SHARED_LIB=OFF', '-Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF', '-Donnxruntime_USE_DNNL=OFF', '-Donnxruntime_DNNL_GPU_RUNTIME=', '-Donnxruntime_DNNL_OPENCL_ROOT=', '-Donnxruntime_USE_NNAPI_BUILTIN=OFF', '-Donnxruntime_USE_RKNPU=OFF', '-Donnxruntime_USE_OPENMP=OFF', '-Donnxruntime_USE_TVM=OFF', '-Donnxruntime_USE_LLVM=OFF', '-Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF', '-Donnxruntime_USE_VITISAI=OFF', '-Donnxruntime_USE_NUPHAR=OFF', '-Donnxruntime_USE_TENSORRT=ON', '-Donnxruntime_TENSORRT_HOME=/home/alphabin/zxh/TensorRT-7.1.3.4/', '-Donnxruntime_USE_MIGRAPHX=OFF', '-Donnxruntime_MIGRAPHX_HOME=', '-Donnxruntime_CROSS_COMPILING=OFF', '-Donnxruntime_DISABLE_CONTRIB_OPS=OFF', '-Donnxruntime_DISABLE_ML_OPS=OFF', '-Donnxruntime_DISABLE_RTTI=OFF', '-Donnxruntime_DISABLE_EXCEPTIONS=OFF', '-Donnxruntime_DISABLE_ORT_FORMAT_LOAD=OFF', '-Donnxruntime_MINIMAL_BUILD=OFF', '-Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF', '-Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF', '-Donnxruntime_REDUCED_OPS_BUILD=OFF', '-Donnxruntime_ENABLE_LANGUAGE_INTEROP_OPS=OFF', '-Donnxruntime_USE_DML=OFF', '-Donnxruntime_USE_WINML=OFF', '-Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF', '-Donnxruntime_USE_TELEMETRY=OFF', '-Donnxruntime_ENABLE_LTO=OFF', '-Donnxruntime_ENABLE_TRANSFORMERS_TOOL_TEST=OFF', '-Donnxruntime_USE_ACL=OFF', '-Donnxruntime_USE_ACL_1902=OFF', '-Donnxruntime_USE_ACL_1905=OFF', '-Donnxruntime_USE_ACL_1908=OFF', '-Donnxruntime_USE_ACL_2002=OFF', '-Donnxruntime_USE_ARMNN=OFF', '-Donnxruntime_ARMNN_RELU_USE_CPU=ON', '-Donnxruntime_ARMNN_BN_USE_CPU=ON', '-Donnxruntime_ENABLE_NVTX_PROFILE=OFF', '-Donnxruntime_ENABLE_TRAINING=OFF', '-Donnxruntime_ENABLE_TRAINING_OPS=OFF', '-Donnxruntime_ENABLE_CPU_FP16_OPS=OFF', '-Donnxruntime_USE_NCCL=ON', '-Donnxruntime_BUILD_BENCHMARKS=OFF', '-Donnxruntime_USE_ROCM=OFF', '-Donnxruntime_ROCM_HOME=', '-DOnnxruntime_GCOV_COVERAGE=OFF', '-Donnxruntime_USE_MPI=ON', '-Donnxruntime_ENABLE_MEMORY_PROFILE=OFF', '-Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF', '-Donnxruntime_BUILD_WEBASSEMBLY=OFF', '-Donnxruntime_ENABLE_WEBASSEMBLY_SIMD=OFF', '-Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON', '-Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF', '-Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF', '-Donnxruntime_WEBASSEMBLY_MALLOC=dlmalloc', '-Donnxruntime_ENABLE_EAGER_MODE=OFF', '-Donnxruntime_ENABLE_EXTENSION_CUSTOM_OPS=OFF', '-Donnxruntime_USE_CUDA=ON', '-Donnxruntime_CUDA_VERSION=', '-Donnxruntime_CUDA_HOME=/usr/local/cuda/lib64/', '-Donnxruntime_CUDNN_HOME=/usr/local/cuda/lib64/', '-DCMAKE_MSVC_RUNTIME_LIBRARY=MultiThreaded$<$<CONFIG:Debug>:Debug>DLL', '-DONNX_USE_MSVC_STATIC_RUNTIME=OFF', '-Dprotobuf_MSVC_STATIC_RUNTIME=OFF', '-Dgtest_force_shared_crt=ON', '-Donnxruntime_USE_FULL_PROTOBUF=ON', '-DProtobuf_USE_STATIC_LIBS=ON', '-DCUDA_CUDA_LIBRARY=/usr/local/cuda/lib64/stubs', '-Donnxruntime_PYBIND_EXPORT_OPSCHEMA=OFF', '-Donnxruntime_ENABLE_MEMLEAK_CHECKER=ON', '-DCMAKE_BUILD_TYPE=Debug']
-- The C compiler identification is GNU 7.5.0
-- The CXX compiler identification is GNU 7.5.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMake Warning at CMakeLists.txt:227 (message):
onnxruntime_ENABLE_TRAINING_TORCH_INTEROP is turned OFF due to incompatible
build combinations.
-- Performing Test onnxruntime_HAVE_BUILTIN_ATOMICS
-- Performing Test onnxruntime_HAVE_BUILTIN_ATOMICS - Success
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Performing Test COMPILER_SUPPORT_MF16C
-- Performing Test COMPILER_SUPPORT_MF16C - Success
-- Performing Test COMPILER_SUPPORT_FMA
-- Performing Test COMPILER_SUPPORT_FMA - Success
-- Performing Test COMPILER_SUPPORT_AVX
-- Performing Test COMPILER_SUPPORT_AVX - Success
Use gtest from submodule
-- Found Python: /home/alphabin/anaconda3/bin/python3 (found version "3.7.4") found components: Interpreter
-- Found Python: /home/alphabin/anaconda3/bin/python3 (found suitable version "3.7.4", minimum required is "3.6") found components: Interpreter Development.Module NumPy
Use protobuf from submodule
--
-- 3.16.0.0
-- Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version "1.2.8")
-- Performing Test protobuf_HAVE_BUILTIN_ATOMICS
-- Performing Test protobuf_HAVE_BUILTIN_ATOMICS - Success
# date: USE_SYSTEM_TZ_DB ON
# date: USE_TZ_DB_IN_DOT OFF
# date: BUILD_SHARED_LIBS OFF
# date: ENABLE_DATE_TESTING OFF
-- Using the single-header code from /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/cmake/external/json/single_include/
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- Performing Test HAS_UNUSED_BUT_SET_VARIABLE
-- Performing Test HAS_UNUSED_BUT_SET_VARIABLE - Success
-- Performing Test HAS_UNUSED_PARAMETER
-- Performing Test HAS_UNUSED_PARAMETER - Success
-- Performing Test HAS_UNUSED_VARIABLE
-- Performing Test HAS_UNUSED_VARIABLE - Success
-- Performing Test HAS_CAST_FUNCTION_TYPE
-- Performing Test HAS_CAST_FUNCTION_TYPE - Failed
-- Performing Test HAS_PARENTHESES
-- Performing Test HAS_PARENTHESES - Success
-- Performing Test HAS_USELESS_CAST
-- Performing Test HAS_USELESS_CAST - Success
-- Performing Test HAS_NONNULL_COMPARE
-- Performing Test HAS_NONNULL_COMPARE - Success
-- Performing Test HAS_TAUTOLOGICAL_POINTER_COMPARE
-- Performing Test HAS_TAUTOLOGICAL_POINTER_COMPARE - Failed
-- Performing Test HAS_CATCH_VALUE
-- Performing Test HAS_CATCH_VALUE - Failed
-- Performing Test HAS_MISSING_BRACES
-- Performing Test HAS_MISSING_BRACES - Success
-- Performing Test HAS_IGNORED_ATTRIBUTES
-- Performing Test HAS_IGNORED_ATTRIBUTES - Success
-- Performing Test HAS_DEPRECATED_COPY
-- Performing Test HAS_DEPRECATED_COPY - Failed
-- Performing Test HAS_DEPRECATED_DECLARATIONS
-- Performing Test HAS_DEPRECATED_DECLARATIONS - Success
-- Performing Test HAS_CLASS_MEMACCESS
-- Performing Test HAS_CLASS_MEMACCESS - Failed
-- Performing Test HAS_MAYBE_UNINITIALIZED
-- Performing Test HAS_MAYBE_UNINITIALIZED - Success
-- Performing Test HAS_STRICT_ALIASING
-- Performing Test HAS_STRICT_ALIASING - Success
NVCC_ERROR =
NVCC_OUT = No such file or directory
-- Performing Test HAS_AMBIGUOUS_REVERSED_OPERATOR
-- Performing Test HAS_AMBIGUOUS_REVERSED_OPERATOR - Failed
-- Performing Test HAS_DEPRECATED_ANON_ENUM_ENUM_CONVERSION
-- Performing Test HAS_DEPRECATED_ANON_ENUM_ENUM_CONVERSION - Failed
-- Performing Test HAS_UNDEFINED_VAR_TEMPLATE
-- Performing Test HAS_UNDEFINED_VAR_TEMPLATE - Failed
-- Found PythonInterp: /home/alphabin/anaconda3/bin/python3 (found version "3.7.4")
-- Found PythonLibs: /home/alphabin/anaconda3/lib/libpython3.7m.so (found version "3.7.4")
Generated: /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/external/onnx/onnx/onnx-ml.proto
Generated: /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/external/onnx/onnx/onnx-operators-ml.proto
Generated: /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug/external/onnx/onnx/onnx-data.proto
--
-- ******** Summary ********
-- CMake version : 3.18.0
-- CMake command : /opt/cmake-3.18.0/bin/cmake
-- System : Linux
-- C++ compiler : /usr/bin/c++
-- C++ compiler version : 7.5.0
-- CXX flags : -ffunction-sections -fdata-sections -Wnon-virtual-dtor
-- Build type : Debug
-- Compile definitions : ENABLE_ORT_FORMAT_LOAD;EIGEN_MPL2_ONLY;PLATFORM_POSIX
-- CMAKE_PREFIX_PATH :
-- CMAKE_INSTALL_PREFIX : /usr/local
-- CMAKE_MODULE_PATH : /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/cmake/external
--
-- ONNX version : 1.9.0
-- ONNX NAMESPACE : onnx
-- ONNX_USE_LITE_PROTO : OFF
-- USE_PROTOBUF_SHARED_LIBS : OFF
-- ONNX_DISABLE_EXCEPTIONS : OFF
-- ONNX_WERROR : OFF
-- ONNX_BUILD_TESTS : OFF
-- ONNX_BUILD_BENCHMARKS : OFF
-- ONNXIFI_DUMMY_BACKEND : OFF
-- ONNXIFI_ENABLE_EXT : OFF
--
-- Protobuf compiler :
-- Protobuf includes :
-- Protobuf libraries :
-- BUILD_ONNX_PYTHON : OFF
-- Looking for strtof_l
-- Looking for strtof_l - found
-- Looking for strtoull_l
-- Looking for strtoull_l - found
-- The CUDA compiler identification is NVIDIA 10.2.89
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: /usr/local/cuda/bin/nvcc - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- CMAKE_CUDA_COMPILER_VERSION: 10.2.89
-- Looking for clock_gettime in rt
-- Looking for clock_gettime in rt - found
-- Found TensorRT headers at /home/alphabin/zxh/TensorRT-7.1.3.4/include
-- Find TensorRT libs at /home/alphabin/zxh/TensorRT-7.1.3.4/lib/libnvinfer.so;/home/alphabin/zxh/TensorRT-7.1.3.4/lib/libnvinfer_plugin.so;/home/alphabin/zxh/TensorRT-7.1.3.4/lib/libmyelin.so
-- Found TENSORRT: /home/alphabin/zxh/TensorRT-7.1.3.4/include
-- The ASM compiler identification is GNU
-- Found assembler: /usr/bin/cc
-- Performing Test HAS_AVX512F
-- Performing Test HAS_AVX512F - Success
-- Performing Test COMPILES_AVX512F
-- Performing Test COMPILES_AVX512F - Success
-- Performing Test COMPILES_AVX512F_INTRINSICS
-- Performing Test COMPILES_AVX512F_INTRINSICS - Success
-- Performing Test HAS_AVX512CORE
-- Performing Test HAS_AVX512CORE - Success
-- Performing Test COMPILES_AVX512CORE
-- Performing Test COMPILES_AVX512CORE - Success
CMake Warning at flake8.cmake:19 (message):
Could not find 'flake8' to check python scripts. Please install flake8
using pip.
Call Stack (most recent call first):
CMakeLists.txt:1758 (include)
-- Configuring done
-- Generating done
CMake Warning:
Manually-specified variables were not used by the project:
CUDA_CUDA_LIBRARY
ONNX_USE_MSVC_STATIC_RUNTIME
Protobuf_USE_STATIC_LIBS
onnxruntime_BUILD_WINML_TESTS
onnxruntime_CUDA_VERSION
onnxruntime_DNNL_GPU_RUNTIME
onnxruntime_DNNL_OPENCL_ROOT
onnxruntime_ENABLE_TRANSFORMERS_TOOL_TEST
onnxruntime_ENABLE_WEBASSEMBLY_SIMD
onnxruntime_MIGRAPHX_HOME
onnxruntime_ROCM_HOME
onnxruntime_ROCM_VERSION
onnxruntime_WEBASSEMBLY_MALLOC
-- Build files have been written to: /home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug
2021-07-04 07:26:05,008 util.run [DEBUG] - Subprocess completed. Return code: 0
2021-07-04 07:26:05,008 build [INFO] - Building targets for Debug configuration
2021-07-04 07:26:05,009 util.run [INFO] - Running subprocess in '/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime'
['/usr/bin/cmake', '--build', '/home/alphabin/Desktop/debug_stark_lightnng_X/onnxruntime/build/Linux/Debug', '--config', 'Debug', '--', '-j32']
Scanning dependencies of target custom_op_library
Scanning dependencies of target flatbuffers
[ 0%] Generating cpp/platform/c++11/src/nsync_panic.cc
Scanning dependencies of target pybind11
Scanning dependencies of target onnxruntime_test_cuda_ops_lib
[ 0%] Generating cpp/internal/common.c
[ 0%] Generating cpp/internal/counter.c
Scanning dependencies of target onnxruntime_providers_shared
[ 0%] Generating cpp/internal/cv.c
[ 0%] Generating cpp/internal/debug.c
The command I ran in order to build with TensorRT support was:
./build.sh --parallel --build --update --config Release --cuda_home /usr/local/cuda --cudnn_home /usr/local/cuda/lib64 --tensorrt_home /home/cgarcia/Documentos/tensorrt/TensorRT-7.2.3.4 --use_tensorrt --build_wheel --cmake_extra_defines ONNXRUNTIME_VERSION=$(cat ./VERSION_NUMBER) --cuda_version=11.4 --enable_pybind