[BUG] <infer schema should not include the auto generated columns>
minnieshi opened this issue · comments
Min Shi commented
Is there an existing issue for this?
- I have searched the existing issues
Current Behavior
when reading excel with 'infer schema' enabled, if the file has extra empty columns towards to the end, it is read/added in as auto generated columns like c_ddd, where ddd is the digits
Expected Behavior
it should not add those auto generated columns if infer schema is turned on
and it should not add either for custom schema
Steps To Reproduce
No response
Environment
- Spark version:
- Spark-Excel version:
- OS:
- Cluster environment
Anything else?
No response