Refactor ParquetReader initializeSchema.
majetideepak opened this issue · comments
Deepak Majeti commented
Description
The ParquetReader initializeSchema needs a refactor. There are too many branches and special cases.
https://github.com/facebookincubator/velox/blob/main/velox/dwio/parquet/reader/ParquetReader.cpp#L233
It was also hard to investigate this in production since standard exceptions are only caught in the TableScan operator. We need to add a standard exception check at the Parquet Parser level.
Deepak Majeti commented
Remaining part of #11589