use DirectML: CreateSession(Msg("Exception during initialization: "))

Question

use DirectML: CreateSession(Msg("Exception during initialization: "))

Curtion opened this issue 4 months ago · comments

ERROR : called Result::unwrap() on an Err value: CreateSession(Msg("Exception during initialization: "))

log details

direct_ml OK!
2024-03-28T12:44:46.716160Z DEBUG ort::environment: Environment not yet initialized, creating a new one
2024-03-28T12:44:46.727683Z DEBUG ort::environment: Environment created env_ptr="0x24a9251ee60"
2024-03-28T12:44:46.728494Z DEBUG ort::environment: Session Options {  execution_mode:0 execution_order:DEFAULT enable_profiling:0 optimized_model_filepath: enable_mem_pattern:1 enable_mem_reuse:1 enable_cpu_mem_arena:1 profile_file_prefix:onnxruntime_profile_ session_logid: session_log_severity_level:-1 session_log_verbosity_level:0 max_num_graph_transformation_steps:10 graph_optimization_level:3 intra_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str:  set_denormal_as_zero: 0 } inter_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str:  set_denormal_as_zero: 0 } use_per_session_threads:1 thread_pool_allow_spinning:1 use_deterministic_compute:0 config_options: {  } }
2024-03-28T12:44:46.728622Z DEBUG ort::environment: Flush-to-zero and denormal-as-zero are off
2024-03-28T12:44:46.728669Z DEBUG ort::environment: Creating and using per session threadpools since use_per_session_threads_ is true
2024-03-28T12:44:46.728725Z DEBUG ort::environment: Dynamic block base set to 0
2024-03-28T12:44:46.746262Z DEBUG ort::environment: Having memory pattern enabled is not supported while using the DML Execution Provider. So disabling it for this session since it uses the DML Execution Provider.
2024-03-28T12:44:46.746366Z DEBUG ort::environment: Initializing session.
2024-03-28T12:44:46.746403Z DEBUG ort::environment: Adding default CPU execution provider.
2024-03-28T12:44:46.746472Z DEBUG ort::environment: Creating BFCArena for Cpu with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 initial_growth_chunk_size_bytes: 2097152 max_power_of_two_extend_bytes: 1073741824 memory limit: 18446744073709551615 arena_extend_strategy: 0
2024-03-28T12:44:46.748453Z DEBUG ort::environment: This model does not have any local functions defined. AOT Inlining is not performed
2024-03-28T12:44:46.748648Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.748843Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 1 with status: OK
2024-03-28T12:44:46.750301Z DEBUG ort::environment: Removing initializer '/model.22/Constant_7_output_0'. It is no longer used by any node.
2024-03-28T12:44:46.750429Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.750637Z DEBUG ort::environment: Total shared scalar initializer count: 5
2024-03-28T12:44:46.750705Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.752190Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.752601Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 1 with status: OK
2024-03-28T12:44:46.753748Z DEBUG ort::environment: Removing initializer '/model.22/Add_output_0'. It is no longer used by any node.
2024-03-28T12:44:46.753896Z DEBUG ort::environment: Removing initializer 'ortshared_7_1_1_0'. It is no longer used by any node.
2024-03-28T12:44:46.753969Z DEBUG ort::environment: Removing initializer '/model.22/Shape_output_0'. It is no longer used by any node.
2024-03-28T12:44:46.754041Z DEBUG ort::environment: Removing initializer '/model.22/Gather_output_0'. It is no longer used by any node.
2024-03-28T12:44:46.754198Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.754339Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.754418Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.754570Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.754720Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.754845Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.755151Z DEBUG ort::environment: GraphTransformer TransposeOptimizer modified: 0 with status: OK
2024-03-28T12:44:46.755307Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.755404Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.755595Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.756943Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.757087Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.757194Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.757326Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.757417Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.757572Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.757733Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.757864Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.758021Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.758220Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.758472Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.760534Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.760750Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.760923Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.761061Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.761133Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.761265Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.761381Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.761484Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.761629Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.761721Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.761971Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.763975Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.764176Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.764328Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.764465Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.764540Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.764685Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.764813Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.764902Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.765032Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.765121Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.765343Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.766947Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.767099Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.767236Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.767358Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.767432Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.767573Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.767713Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.767823Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.767972Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.768079Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.768278Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.770291Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.770513Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.770696Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.770841Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.770923Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.771063Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.771185Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.771274Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.771442Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.771567Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.771886Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.773860Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.774012Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.774111Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.774212Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.774272Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.774396Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.774565Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.774720Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.774946Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.775076Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.775336Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.777001Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.777158Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.777262Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.777357Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.777419Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.777565Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.777710Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.777833Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.778024Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.778248Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.778536Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.780028Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.780169Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.780277Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.780398Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.780468Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.780623Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.780757Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.780926Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.781146Z DEBUG ort::environment: GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK
2024-03-28T12:44:46.781342Z DEBUG ort::environment: GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK
2024-03-28T12:44:46.781615Z DEBUG ort::environment: GraphTransformer ConstantSharing modified: 1 with status: OK
2024-03-28T12:44:46.783424Z DEBUG ort::environment: GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK
2024-03-28T12:44:46.783648Z DEBUG ort::environment: GraphTransformer ConstantFolding modified: 0 with status: OK
2024-03-28T12:44:46.783778Z DEBUG ort::environment: GraphTransformer MatMulAddFusion modified: 0 with status: OK
2024-03-28T12:44:46.783926Z DEBUG ort::environment: GraphTransformer ReshapeFusion modified: 0 with status: OK
2024-03-28T12:44:46.784009Z DEBUG ort::environment: GraphTransformer FreeDimensionOverrideTransformer modified: 0 with status: OK
2024-03-28T12:44:46.784163Z DEBUG ort::environment: GraphTransformer QDQPropagationTransformer modified: 0 with status: OK
2024-03-28T12:44:46.784305Z DEBUG ort::environment: GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK
2024-03-28T12:44:46.784399Z DEBUG ort::environment: GraphTransformer RocmBlasAltImpl modified: 0 with status: OK
2024-03-28T12:44:46.786029Z DEBUG ort::environment: GraphTransformer TransposeOptimizer_CPUExecutionProvider modified: 0 with status: OK
2024-03-28T12:44:46.786169Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.786353Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.786487Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.786624Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.786763Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.786886Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.787027Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.787180Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.787416Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.787599Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.787775Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.788050Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.788205Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.788401Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.788581Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.788758Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.788915Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.789424Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 1 with status: OK
2024-03-28T12:44:46.790966Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.791102Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.791250Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.791369Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.791483Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.791592Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.791691Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.791849Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.791940Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.792047Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.792156Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.792255Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.792357Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.792464Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.792576Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.792670Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.792761Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.792919Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.793010Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.793102Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.793191Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.793307Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.793458Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.793656Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.793801Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.794057Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.794231Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.794412Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.794582Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.794710Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.794836Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.795024Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.795153Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.795283Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.795426Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.795544Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.795666Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.795810Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.795968Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.796085Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.796195Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.796399Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.796519Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.796643Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.796759Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.796863Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.796983Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.797101Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.797213Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.797312Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.797433Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.797534Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.797649Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.797752Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.797846Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.798003Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.798104Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.798203Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.798295Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.798379Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.798470Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.798555Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.798641Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.798724Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.798823Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.798983Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.799077Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.799177Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.799264Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.799351Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.799442Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.799607Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.799748Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.799851Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.800009Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.800153Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.800323Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.800460Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.800629Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.800834Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.800974Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.801109Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.801258Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.801367Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.801489Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.801614Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.801730Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.801862Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.801968Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.802154Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.802244Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.802350Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.802454Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.802570Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.802679Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.802815Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.802938Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.803049Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.803165Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.803300Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.803447Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.803564Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.803675Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.803851Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.803992Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.804123Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.804230Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.804324Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.804426Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.804529Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.804647Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.804754Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.804863Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.805037Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.805141Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.805234Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.805332Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.805425Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.805533Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.805649Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.805765Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.805873Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.805992Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.806144Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.806315Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.806492Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.806655Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.806843Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.807004Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.807163Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.807311Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.807486Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.807649Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.807778Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.807935Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.808061Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.808219Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.808417Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.808535Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.808665Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.808796Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.808911Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.809033Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.809156Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.809351Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.809469Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.809615Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.809798Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.809989Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.810140Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.810282Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.810477Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.810590Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.810702Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.810811Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.810919Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.811020Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.811110Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.811194Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.811278Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.811381Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.811564Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.811679Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.811790Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.811904Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.812021Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.812172Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.812341Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.812490Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.812626Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.812786Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.812956Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.813109Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.813242Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.813386Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.813591Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.813744Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.813898Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.814071Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.814206Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.814332Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.814459Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.814581Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.814690Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.814801Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.814995Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.815102Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.815227Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.815343Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.815445Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.815636Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.815837Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.815980Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.816084Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.816285Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.816478Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.816672Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.816822Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.816996Z DEBUG ort::environment: GraphTransformer QDQS8ToU8Transformer modified: 0 with status: OK
2024-03-28T12:44:46.817263Z DEBUG ort::environment: GraphTransformer QDQSelectorActionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.817423Z DEBUG ort::environment: GraphTransformer GemmActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.817612Z DEBUG ort::environment: GraphTransformer MatMulIntegerToFloatFusion modified: 0 with status: OK
2024-03-28T12:44:46.817817Z DEBUG ort::environment: GraphTransformer DynamicQuantizeMatMulFusion modified: 0 with status: OK
2024-03-28T12:44:46.817955Z DEBUG ort::environment: GraphTransformer ConvActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.818114Z DEBUG ort::environment: GraphTransformer GeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.818267Z DEBUG ort::environment: GraphTransformer LayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.818413Z DEBUG ort::environment: GraphTransformer SimplifiedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.818578Z DEBUG ort::environment: GraphTransformer AttentionFusion modified: 0 with status: OK
2024-03-28T12:44:46.818710Z DEBUG ort::environment: GraphTransformer EmbedLayerNormFusion modified: 0 with status: OK
2024-03-28T12:44:46.818953Z DEBUG ort::environment: GraphTransformer GatherToSplitFusion modified: 0 with status: OK
2024-03-28T12:44:46.819095Z DEBUG ort::environment: GraphTransformer GatherToSliceFusion modified: 0 with status: OK
2024-03-28T12:44:46.819275Z DEBUG ort::environment: GraphTransformer MatmulTransposeFusion modified: 0 with status: OK
2024-03-28T12:44:46.819442Z DEBUG ort::environment: GraphTransformer BiasGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.819653Z DEBUG ort::environment: GraphTransformer SkipLayerNormFusion modified: 1 with status: OK
2024-03-28T12:44:46.819843Z DEBUG ort::environment: GraphTransformer FastGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.820035Z DEBUG ort::environment: GraphTransformer QuickGeluFusion modified: 0 with status: OK
2024-03-28T12:44:46.820203Z DEBUG ort::environment: GraphTransformer BiasSoftmaxFusion modified: 0 with status: OK
2024-03-28T12:44:46.820373Z DEBUG ort::environment: GraphTransformer BiasDropoutFusion modified: 0 with status: OK
2024-03-28T12:44:46.820548Z DEBUG ort::environment: GraphTransformer MatMulScaleFusion modified: 0 with status: OK
2024-03-28T12:44:46.820675Z DEBUG ort::environment: GraphTransformer MatMulActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.820823Z DEBUG ort::environment: GraphTransformer QDQFinalCleanupTransformer modified: 0 with status: OK
2024-03-28T12:44:46.820971Z DEBUG ort::environment: GraphTransformer DmlOperatorFusionTransformer modified: 0 with status: OK
2024-03-28T12:44:46.821130Z DEBUG ort::environment: GraphTransformer NchwcTransformer modified: 0 with status: OK
2024-03-28T12:44:46.821269Z DEBUG ort::environment: GraphTransformer NhwcTransformer modified: 0 with status: OK
2024-03-28T12:44:46.821371Z DEBUG ort::environment: GraphTransformer ConvAddActivationFusion modified: 0 with status: OK
2024-03-28T12:44:46.824238Z  WARN ort::environment: Exception during initialization:
thread 'main' panicked at src\main.rs:20:50:
called `Result::unwrap()` on an `Err` value: CreateSession(Msg("Exception during initialization: "))
stack backtrace:
   0: std::panicking::begin_panic_handler
             at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library\std\src\panicking.rs:645
   1: core::panicking::panic_fmt
             at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library\core\src\panicking.rs:72
   2: core::result::unwrap_failed
             at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library\core\src\result.rs:1649
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

dependencies

ort = { version = "2.0.0-rc.1", features = ["directml"] }

code

let model_bytes = include_bytes!("./model.onnx");
let builder = Session::builder()?;

let direct_ml = DirectMLExecutionProvider::default();
if direct_ml.register(&builder).is_err() {
    eprintln!("direct_ml Error!");
    std::process::exit(1);
}
println!("direct_ml OK!");

let model = builder.commit_from_memory(model_bytes)?;

model

(should remove .txt extension)
model.onnx.txt

Using CPU inference takes 600ms+. I want to accelerate with DirectML, but I encountered this issue. Since this is my first time dealing with machine learning, have I missed some steps? Thank you.

Hobin Ryu · Answer 1 · Thu Mar 28 2024 21:06:05 GMT+0800 (China Standard Time)

Dooray! Failure Notice Failure Notice Your message sent to ***@***.*** has failed to be delivered. Please refer to the below for details. * Recipient : ***@***.*** * Sent time : 2024-03-28T22:06:01 * Subject : [pykeio/ort] use DirectML: CreateSession(Msg("Exception during initialization: ")) (Issue #181) * Remote host said : 대외비/기밀 메일은 외부 계정으로 발송이 제한되어 일부 메일 발송 실패(수신자가 전달 설정한 경우 포함) This message was sent from a notification-only address that cannot accept incoming email. For more information, please contact ***@***.*** © Dooray!.

Carson M. · Answer 2 · Thu Mar 28 2024 23:19:01 GMT+0800 (China Standard Time)

Sorry, there's nothing I can do here, this is an ONNX Runtime issue. Maybe your DirectML/Windows version is incompatible, see here: https://onnxruntime.ai/docs/execution-providers/DirectML-ExecutionProvider.html. Building from source might help too.

Hobin Ryu · Answer 3 · Thu Mar 28 2024 23:19:29 GMT+0800 (China Standard Time)

Dooray! Failure Notice Failure Notice Your message sent to ***@***.*** has failed to be delivered. Please refer to the below for details. * Recipient : ***@***.*** * Sent time : 2024-03-29T00:19:26 * Subject : Re: [pykeio/ort] use DirectML: CreateSession(Msg("Exception during initialization: ")) (Issue #181) * Remote host said : 대외비/기밀 메일은 외부 계정으로 발송이 제한되어 일부 메일 발송 실패(수신자가 전달 설정한 경우 포함) This message was sent from a notification-only address that cannot accept incoming email. For more information, please contact ***@***.*** © Dooray!.

Hobin Ryu · Answer 4 · Thu Mar 28 2024 23:19:29 GMT+0800 (China Standard Time)

Dooray! Failure Notice Failure Notice Your message sent to ***@***.*** has failed to be delivered. Please refer to the below for details. * Recipient : ***@***.*** * Sent time : 2024-03-29T00:19:24 * Subject : Re: [pykeio/ort] use DirectML: CreateSession(Msg("Exception during initialization: ")) (Issue #181) * Remote host said : 대외비/기밀 메일은 외부 계정으로 발송이 제한되어 일부 메일 발송 실패(수신자가 전달 설정한 경우 포함) This message was sent from a notification-only address that cannot accept incoming email. For more information, please contact ***@***.*** © Dooray!.

野草 · Answer 5 · Fri Mar 29 2024 21:45:21 GMT+0800 (China Standard Time)

I used the solution provided by issues and now DirectML is working.