milenkovicm / hdfs-native

HDFS-Native

A rust wrapper over libhdfs3.

This repo is fork of datafusion-contrib/hdfs-native.

NOTE: this crate is not usable for production.

Setup

1. Install libhdfs3

git clone https://github.com/milenkovicm/libhdfs3.git
git branch patch_compile

# then build it
mkdir build && cd build
../bootstrap --prefix=/usr/local
make
make install

Configuration

# client conf to use, env LIBHDFS3_CONF or hdfs-client.xml in working directory
export LIBHDFS3_CONF=/path/to/libhdfs3-hdfs-client.xml