hadoopsters / Pyregrine

A Python wrapper for Apache™ Falcon's RESTful API.

Pyregrine: A Python wrapper for Apache™ Falcon's RESTful API.

=========

What is it?

Pyregrine is a wrapper class for Falcon to simplify Falcon API requests and allow the connection of Falcon jobs to other tools and applications in Hadoop.

DEPENDENCIES

Requests -- http://docs.python-requests.org/en/latest/

INSTALL

pip install Pyregrine

=========

LICENSE

Copyright 2014 James Barney

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

=========

Additional Resources

Apache™ Falcon is a framework for simplifying data management and pipeline processing in Apache Hadoop®. It enables users to automate the movement and processing of datasets for ingest, pipelines, disaster recovery and data retention use cases. Instead of hard-coding complex dataset and pipeline processing logic, users can now rely on Apache Falcon for these functions, maximizing reuse and consistency across Hadoop applications.

http://hortonworks.com/hadoop/falcon/

http://falcon.incubator.apache.org/restapi/ResourceList.html