Giters

OryxProject / oryx

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Home Page:http://oryx.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Avoid FileSystem.get(Configuration)

srowen opened this issue · comments

commented

SaveToHDFSFunction has an instance where a Hadoop FileSystem is obtained not for a path but according to the default Hadoop config. This is a problem when reading from S3, for example. It should simply respect the scheme from the path.