IBMStreams / streamsx.hdfs

This toolkit provides operators and functions for interacting with Hadoop File System.

streamsx.hdfs

This toolkit provides operators and functions for interacting with Hadoop File System.

Releases

HDFS Toolkit v4.5.0 is officially released to support IBM Streams on IBM Cloud:

• https://github.com/IBMStreams/streamsx.hdfs/releases

Changes

CHANGELOG.md

Demos and Samples

Check out the binary read / write support!

• https://github.com/IBMStreams/streamsx.hdfs/tree/develop/demos/HDFSBinary
• https://github.com/IBMStreams/streamsx.hdfs/tree/develop/samples/CompressedHdfsFiles

Check out the Cloud sample!

• https://github.com/IBMStreams/streamsx.hdfs/wiki/How-to-connect-to-IAE-via-HDFS-Toolkit

Kerberos configuration:

• https://github.com/IBMStreams/streamsx.hdfs/wiki/How-to-use-kerberos-authentication-in-streamsx.hdfs-toolkit

Getting started with development

• https://github.com/IBMStreams/streamsx.hdfs/wiki/Getting-Started-with-Developing-HDFS-Toolkit

• Messages and National Language Support for toolkits

Main Site:

• http://ibmstreams.github.io/streamsx.hdfs/

To learn more about Streams:

• IBM Streams on Github
• Introduction to Streams Quick Start Edition
• Streams Getting Started Guide

To learn more about Apache HDFS and Hadoop WebHDFS REST API:

• Apache HDFS User Guide
• Hadoop WebHDFS REST API