pyvista / pyvista

3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)

Home Page:https://docs.pyvista.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Jupyter kernel crashing when loading large files

sreekar2858 opened this issue · comments

Describe the bug, what's wrong, and what you expected.

Hey there
I am doing a grid independent study for a CFD project and I am exporting all the necessary results to ensight gold (.case) format and using pyvista to process the data.
After excruciating debugging hunt, I finally concluded that one of the finest mesh has a 89GB ensight gold export which was causing my jupyter kernel to crash.

I am able to read other results with coarser meshes upto 65GB of ensight gold files. I tried re-exporting but the finest mesh is causing the problem.
The cell in jupyter crashes with the following error:

The Kernel crashed while executing code in the current cell or a previous cell. 
Please review the code in the cell(s) to identify a possible cause of the failure. 
Click [here](https://aka.ms/vscodeJupyterKernelCrash) for more info. 
View Jupyter [log](command:jupyter.viewOutput) for further details.

I have never had this large files before but it is strange to know that there is a limit somehow.
I am using a well equipped HPC for loading the data, so, compute is not the problem.

Would appreciate if anyone can help me with this.
Thanks

Steps to reproduce the bug.

import pyvista as pv
reader = pv.get_reader("mesh.case")
mesh = reader.read()

System Information

--------------------------------------------------------------------------------
  Date: Thu Mar 21 09:17:25 2024 EDT

                OS : Linux
            CPU(s) : 192
           Machine : x86_64
      Architecture : 64bit
               RAM : 1511.1 GiB
       Environment : Jupyter
       File system : xfs
        GPU Vendor : NVIDIA Corporation
      GPU Renderer : NVIDIA A40/PCIe/SSE2
       GPU Version : 4.5.0 NVIDIA 470.182.03
  MathText Support : True

  Python 3.10.13 (main, Mar 13 2024, 18:23:40) [GCC 11.4.1 20230605 (Red Hat
  11.4.1-2)]

           pyvista : 0.43.3
               vtk : 9.3.0
             numpy : 1.26.4
        matplotlib : 3.8.3
            scooby : 0.9.2
             pooch : 1.8.1
            pillow : 10.2.0
             PyQt5 : 5.15.9
           IPython : 8.21.0
        ipywidgets : 7.7.0
             scipy : 1.12.0
        jupyterlab : 4.1.1
             trame : 3.5.2
      trame_client : 2.16.1
      trame_server : 2.17.2
         trame_vtk : 2.8.5
     trame_vuetify : 2.4.2
      nest_asyncio : 1.6.0
--------------------------------------------------------------------------------

Screenshots

No response