sdmxfeeder

Experimental converter for SDMX files. Written in CoffeeScript, runs with Node.

Features

Supports a limited set of SDMX artefacts (basically what is supported in SDMX 1.0):
- Data structure definition
- Concept scheme
- Code list
- Time series data and metadata
Reads following formats
- SDMX-ML (XML) versions 1.0, 2.0, and 2.1
- SDMX-EDI (EDIFACT)
- PC-AXIS
Writes following formats
- SDMX-ML (XML) version 2.1
- JSON
- CSV
- oData
JSON is not supported by the SDMX technical standards. Examples directory contains some sample JSON files.
Validates input data. Generic validation rules are defined in JSON Schema format. Data structure specific validation is also supported.
Streams data from input to output. Should convert and check large files.
PC-AXIS support is limited to files without KEYS.
Reads and writes compressed files. If the file name ends with ".gz" it will be compressed/decompressed [Update: looks like zip is not working afterall. Use .gz if you need file compression].
The file extension for oData is atom.

Installation

Linux

Check that Node.js and NPM package manager are installed:

$ node -v
v0.6.14
$ npm -v
1.1.1

Download and expand sdmxfeeder:

$ curl --location https://github.com/airosa/sdmxfeeder/tarball/master | tar zx

Alternatively clone the repo:

$ git clone git://github.com/airosa/sdmxfeeder.git

Finally in the sdmxfeeder directory run:

$ make install

Usage

Run from the install directory:

bin/sdmxfeeder my_input_sdmx_file.xml my_output_sdmx_file.json

File formats depend on the file extensions: .xml -> XML, .json -> JSON, .edi -> EDIFACT, .atom -> oData. Additional extensions for compressed file are .gz and .zip (e.g. myfile.xml.gz).

Conversion of all SDMX-EDI and some SDMX-ML data files requires access to the relevant data structure definitions. Create a directory named registry in the current directory and copy the structure files (in any supported format) there. Application will use them automatically.

Production quality tools

SDMX tools registry contains links to production quality tools for converting SDMX files. Many of the tools are available free of charge.

airosa / sdmxfeeder