crealytics / spark-excel

A Spark plugin for reading and writing Excel files

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[BUG] <infer schema should not include the auto generated columns>

minnieshi opened this issue · comments

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

when reading excel with 'infer schema' enabled, if the file has extra empty columns towards to the end, it is read/added in as auto generated columns like c_ddd, where ddd is the digits

Expected Behavior

it should not add those auto generated columns if infer schema is turned on

and it should not add either for custom schema

Steps To Reproduce

No response

Environment

- Spark version:
- Spark-Excel version:
- OS:
- Cluster environment

Anything else?

No response