yongfei25 / nodejs-stream-transformation-examples

Examples of using Node.js stream for data transformation.

Node.js Stream Transformation Examples

This repository contains examples for data transformation in Node.js stream. You can find the list of examples in table of contents below.

More about stream API in Node.js, kindly see: https://nodejs.org/api/stream.html#stream_api_for_stream_consumers

Table of Contents

1. Copy & gunzip file.
2. Read & break data into lines.
3. Filter and transform data.
4. Using stream to transform data from/to S3 object.
5. Fork to multiple output destination.

Helpful Packages

• split2 - Break up a stream and reassemble it so that each line is a chunk.
• through2 - A tiny wrapper around Node streams.