Build from source getting stuck at `running build_ext`
Abhishekghosh1998 opened this issue · comments
I am trying to build triton from source, but I am facing the issue, that the build gets stuck at running build_ext
(pytorch-venv) abhishek@abhishek:/media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton$ pip install -e python --verbose
Using pip 22.0.2 from /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages/pip (python 3.10)
Obtaining file:///media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python
Running command pip subprocess to install build dependencies
Collecting setuptools>=40.8.0
Using cached setuptools-70.0.0-py3-none-any.whl (863 kB)
Collecting wheel
Using cached wheel-0.43.0-py3-none-any.whl (65 kB)
Collecting cmake>=3.18
Using cached cmake-3.29.3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (26.7 MB)
Collecting ninja>=1.11.1
Using cached ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl (307 kB)
Installing collected packages: ninja, wheel, setuptools, cmake
Successfully installed cmake-3.29.3 ninja-1.11.1.1 setuptools-70.0.0 wheel-0.43.0
Installing build dependencies ... done
Running command Checking if build backend supports build_editable
Checking if build backend supports build_editable ... done
Running command Getting requirements to build editable
copy /home/abhishek/.triton/nvidia/ptxas/bin/ptxas to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/ptxas ...
copy /home/abhishek/.triton/nvidia/cuobjdump/bin/cuobjdump to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/cuobjdump ...
copy /home/abhishek/.triton/nvidia/nvdisasm/bin/nvdisasm to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/nvdisasm ...
copy /home/abhishek/.triton/nvidia/cudacrt/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
copy /home/abhishek/.triton/nvidia/cudart/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
copy /home/abhishek/.triton/nvidia/cupti/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
running egg_info
writing triton.egg-info/PKG-INFO
writing dependency_links to triton.egg-info/dependency_links.txt
writing entry points to triton.egg-info/entry_points.txt
writing requirements to triton.egg-info/requires.txt
writing top-level names to triton.egg-info/top_level.txt
reading manifest file 'triton.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'triton.egg-info/SOURCES.txt'
Getting requirements to build editable ... done
Running command Preparing editable metadata (pyproject.toml)
copy /home/abhishek/.triton/nvidia/ptxas/bin/ptxas to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/ptxas ...
copy /home/abhishek/.triton/nvidia/cuobjdump/bin/cuobjdump to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/cuobjdump ...
copy /home/abhishek/.triton/nvidia/nvdisasm/bin/nvdisasm to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/nvdisasm ...
copy /home/abhishek/.triton/nvidia/cudacrt/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
copy /home/abhishek/.triton/nvidia/cudart/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
copy /home/abhishek/.triton/nvidia/cupti/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
running dist_info
creating /tmp/pip-modern-metadata-rj8b53xq/triton.egg-info
writing /tmp/pip-modern-metadata-rj8b53xq/triton.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-modern-metadata-rj8b53xq/triton.egg-info/dependency_links.txt
writing entry points to /tmp/pip-modern-metadata-rj8b53xq/triton.egg-info/entry_points.txt
writing requirements to /tmp/pip-modern-metadata-rj8b53xq/triton.egg-info/requires.txt
writing top-level names to /tmp/pip-modern-metadata-rj8b53xq/triton.egg-info/top_level.txt
writing manifest file '/tmp/pip-modern-metadata-rj8b53xq/triton.egg-info/SOURCES.txt'
reading manifest file '/tmp/pip-modern-metadata-rj8b53xq/triton.egg-info/SOURCES.txt'
creating '/tmp/pip-modern-metadata-rj8b53xq/triton-3.0.0.dist-info'
Preparing editable metadata (pyproject.toml) ... done
Collecting llnl-hatchet
Using cached llnl_hatchet-2024.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
Requirement already satisfied: filelock in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from triton==3.0.0) (3.13.1)
Collecting pydot
Using cached pydot-2.0.0-py3-none-any.whl (22 kB)
Collecting matplotlib
Using cached matplotlib-3.9.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.3 MB)
Requirement already satisfied: PyYAML in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from llnl-hatchet->triton==3.0.0) (6.0.1)
Requirement already satisfied: pandas in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from llnl-hatchet->triton==3.0.0) (2.2.1)
Collecting multiprocess
Using cached multiprocess-0.70.16-py310-none-any.whl (134 kB)
Collecting textX>=3.0.0
Using cached textx-4.0.1-py3-none-any.whl (66 kB)
Requirement already satisfied: numpy in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from llnl-hatchet->triton==3.0.0) (1.26.4)
Collecting caliper-reader
Using cached caliper_reader-0.4.0-py3-none-any.whl (10 kB)
Collecting Arpeggio>=2.0.0
Using cached Arpeggio-2.0.2-py2.py3-none-any.whl (55 kB)
Collecting fonttools>=4.22.0
Using cached fonttools-4.51.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB)
Requirement already satisfied: packaging>=20.0 in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from matplotlib->llnl-hatchet->triton==3.0.0) (24.0)
Collecting cycler>=0.10
Using cached cycler-0.12.1-py3-none-any.whl (8.3 kB)
Collecting pyparsing>=2.3.1
Using cached pyparsing-3.1.2-py3-none-any.whl (103 kB)
Requirement already satisfied: python-dateutil>=2.7 in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from matplotlib->llnl-hatchet->triton==3.0.0) (2.9.0.post0)
Collecting contourpy>=1.0.1
Using cached contourpy-1.2.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (305 kB)
Requirement already satisfied: pillow>=8 in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from matplotlib->llnl-hatchet->triton==3.0.0) (9.3.0)
Collecting kiwisolver>=1.3.1
Using cached kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB)
Collecting dill>=0.3.8
Using cached dill-0.3.8-py3-none-any.whl (116 kB)
Requirement already satisfied: tzdata>=2022.7 in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from pandas->llnl-hatchet->triton==3.0.0) (2024.1)
Requirement already satisfied: pytz>=2020.1 in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from pandas->llnl-hatchet->triton==3.0.0) (2024.1)
Requirement already satisfied: six>=1.5 in /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/pytorch-venv/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib->llnl-hatchet->triton==3.0.0) (1.16.0)
Building wheels for collected packages: triton
Running command Building editable for triton (pyproject.toml)
copy /home/abhishek/.triton/nvidia/ptxas/bin/ptxas to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/ptxas ...
copy /home/abhishek/.triton/nvidia/cuobjdump/bin/cuobjdump to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/cuobjdump ...
copy /home/abhishek/.triton/nvidia/nvdisasm/bin/nvdisasm to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/bin/nvdisasm ...
copy /home/abhishek/.triton/nvidia/cudacrt/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
copy /home/abhishek/.triton/nvidia/cudart/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
copy /home/abhishek/.triton/nvidia/cupti/include to /media/abhishek/Abhishek_NVMe/shweta_machine/trace_analysis/triton/python/../third_party/nvidia/backend/include ...
running editable_wheel
creating /tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info
writing /tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info/dependency_links.txt
writing entry points to /tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info/entry_points.txt
writing requirements to /tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info/requires.txt
writing top-level names to /tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info/top_level.txt
writing manifest file '/tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info/SOURCES.txt'
reading manifest file '/tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file '/tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton.egg-info/SOURCES.txt'
creating '/tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton-3.0.0.dist-info'
creating /tmp/pip-wheel-80strk5u/.tmp-gwy5ihmt/triton-3.0.0.dist-info/WHEEL
running build_py
running build_ext
Any suggestions on how to fix this issue?
This usually mean it is downloading llvm, it might take time based on your connection.
Yeah. There was a speed throttling, back then, but now it proceeded beyond that.