A training error: Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis...

[Langyuan Mo]

Hi, at the beginning of the training, an error occur:

2020-10-20 16:10:17.143274: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1528. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143391: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1542. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143422: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1556. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143449: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1570. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143473: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1584. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143637: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1604. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143663: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1618. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143687: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1632. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143712: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1646. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.143735: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_1660. Error: ValidateStridedSliceOp returned partial shapes [1,?,3] and [?,3]
2020-10-20 16:10:17.161784: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2167. Error: Node strided_slice_2167 requested invalid slice index 2 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.161862: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2170. Error: Node strided_slice_2170 requested invalid slice index 3 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.161909: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2173. Error: Node strided_slice_2173 requested invalid slice index 4 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.161953: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2176. Error: Node strided_slice_2176 requested invalid slice index 5 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.161992: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2179. Error: Node strided_slice_2179 requested invalid slice index 6 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.162030: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2182. Error: Node strided_slice_2182 requested invalid slice index 7 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.162091: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2185. Error: Node strided_slice_2185 requested invalid slice index 8 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.162142: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2188. Error: Node strided_slice_2188 requested invalid slice index 9 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.162197: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2191. Error: Node strided_slice_2191 requested invalid slice index 10 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.162246: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2194. Error: Node strided_slice_2194 requested invalid slice index 11 on axis 1 from tensor of shape: [5,68,2]
2020-10-20 16:10:17.162295: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_2197. Error: Node strided_slice_2197 requested invalid slice index 12 on axis 1 from tensor of shape: [5,68,2]
........

But the model can be trained afer these errors occurred.

.......

2020-10-20 16:10:17.839343: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_4312. Error: ValidateStridedSliceOp returned partial shapes [?,1,2] and [?,2]
2020-10-20 16:10:17.839375: W ./tensorflow/core/grappler/optimizers/graph_optimizer_stage.h:241] Failed to run optimizer ArithmeticOptimizer, stage RemoveStackStridedSliceSameAxis node strided_slice_4315. Error: ValidateStridedSliceOp returned partial shapes [?,1,2] and [?,2]
Epoch  1:   100/  100 (time: 8.7066), Step 100:
total: [0.9219]
ga/pixel/ssim/depth/epipolar loss: [0.0000/0.0000/0.0000/0.0000/0.0000]
(weight)ga/pixel/ssim/depth/epipolar loss: [0.0000/0.0000/0.0000/0.0000/0.0000]
mm_pixel/mm_lm/mm_id/mm_reg_s/mm_reg_c loss: [0.2579/241.8536/0.9496/1.2511/0.0017]
(weight)mm_pixel/mm_lm/mm_id/mm_reg_s/mm_reg_c loss: [0.4900/0.2419/0.1899/0.0001/0.0000]

Epoch  1:   200/  200 (time: 0.5535), Step 200:
total: [1.4828]
ga/pixel/ssim/depth/epipolar loss: [0.0732/0.1618/0.0000/164.9637/32.4154]
(weight)ga/pixel/ssim/depth/epipolar loss: [0.0732/0.1618/0.0000/0.0165/0.0324]
mm_pixel/mm_lm/mm_id/mm_reg_s/mm_reg_c loss: [0.3084/659.8826/0.8153/7.1344/0.0120]
(weight)mm_pixel/mm_lm/mm_id/mm_reg_s/mm_reg_c loss: [0.5859/0.6599/0.1631/0.0007/0.0000]

Is this situation normal? If not, how can I avoid it?

[jiaxiangshang]

Yes man, do not worry about this.

This is a TensorFlow version problem.