Trace page in tensorboard remains empty

Question

Trace page in tensorboard remains empty

robogast opened this issue 8 months ago · comments

Robert Jan Schlimbach commented 8 months ago

The trace view is one of my most important tools for profiling pytorch programs, but for the last few days I cannot manage to get it to display anything:

I can see that one of the processes of tensorboard is in 'Zombie' mode:

Things I've tried to fix this crash:

Use toch_tb_profiler version 0.4.1 and 0.4.3
Use tensorboard version 2.11 and 2.14
I've checked that the plugin.py::trace_route function returns 'as expected' (or at least doesn't crash)

I'll update this issue as I investigate further

Sunghyun Jun · Answer 1 · Thu Oct 19 2023 12:52:14 GMT+0800 (China Standard Time)

I don't know exactly but I had same problem. And I found this issue occurs when trace.json is lager than 500MB. I manually cut last part of trace.json to make smaller than 500MB and it worked. I think chrome://tracing may be the cause of the problem.

Robert Jan Schlimbach · Answer 2 · Mon Oct 23 2023 22:29:08 GMT+0800 (China Standard Time)

I was able to analyze the trace through https://ui.perfetto.dev/ (with native acceleration) on chrome (didn't work on firefox)

botbw · Answer 3 · Wed May 01 2024 14:41:34 GMT+0800 (China Standard Time)

I was able to analyze the trace through https://ui.perfetto.dev/ (with native acceleration) on chrome (didn't work on firefox)

This app works for me ;)