Jupyter kernel crashing when loading large files
sreekar2858 opened this issue · comments
Describe the bug, what's wrong, and what you expected.
Hey there
I am doing a grid independent study for a CFD project and I am exporting all the necessary results to ensight gold (.case) format and using pyvista to process the data.
After excruciating debugging hunt, I finally concluded that one of the finest mesh has a 89GB ensight gold export which was causing my jupyter kernel to crash.
I am able to read other results with coarser meshes upto 65GB of ensight gold files. I tried re-exporting but the finest mesh is causing the problem.
The cell in jupyter crashes with the following error:
The Kernel crashed while executing code in the current cell or a previous cell.
Please review the code in the cell(s) to identify a possible cause of the failure.
Click [here](https://aka.ms/vscodeJupyterKernelCrash) for more info.
View Jupyter [log](command:jupyter.viewOutput) for further details.
I have never had this large files before but it is strange to know that there is a limit somehow.
I am using a well equipped HPC for loading the data, so, compute is not the problem.
Would appreciate if anyone can help me with this.
Thanks
Steps to reproduce the bug.
import pyvista as pv
reader = pv.get_reader("mesh.case")
mesh = reader.read()
System Information
--------------------------------------------------------------------------------
Date: Thu Mar 21 09:17:25 2024 EDT
OS : Linux
CPU(s) : 192
Machine : x86_64
Architecture : 64bit
RAM : 1511.1 GiB
Environment : Jupyter
File system : xfs
GPU Vendor : NVIDIA Corporation
GPU Renderer : NVIDIA A40/PCIe/SSE2
GPU Version : 4.5.0 NVIDIA 470.182.03
MathText Support : True
Python 3.10.13 (main, Mar 13 2024, 18:23:40) [GCC 11.4.1 20230605 (Red Hat
11.4.1-2)]
pyvista : 0.43.3
vtk : 9.3.0
numpy : 1.26.4
matplotlib : 3.8.3
scooby : 0.9.2
pooch : 1.8.1
pillow : 10.2.0
PyQt5 : 5.15.9
IPython : 8.21.0
ipywidgets : 7.7.0
scipy : 1.12.0
jupyterlab : 4.1.1
trame : 3.5.2
trame_client : 2.16.1
trame_server : 2.17.2
trame_vtk : 2.8.5
trame_vuetify : 2.4.2
nest_asyncio : 1.6.0
--------------------------------------------------------------------------------
Screenshots
No response