crealytics / spark-excel

A Spark plugin for reading and writing Excel files

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[BUG] error on reading excel files from abfs with DatasourceV2 API

blcksrx opened this issue · comments

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

spark-excel DataSourceV2 API throws NoSuchFileException on this code block:

spark.
  read.
  format("excel").
  options(...).
  load("abfss://container@account.dfs.core.windows.net/folder/data.xlsx")

While changing the format from excel to com.crealytics.spark.excel solves the problem.

Expected Behavior

No response

Steps To Reproduce

No response

Environment

- Spark version: 2.4.4
- Spark-Excel version: 2.4.8_0.18.5
- OS: spark-operator on k8s
- Cluster environment

Anything else?

No response