zillow / intake-hive

Intake plugin to read and write to Hive

Welcome to the Intake Hive plugin

This Intake plugin :

Example where the Hive table is user_events_hive partitioned by userid:

sources:
  user_events_hive:
    driver: hive
    args:
      urlpath: 'user_events_yaml_catalog?userid={{userid}}'

import pandas as pd
import intake

catalog = intake.open_catalog(catalog_path)

# Reads partition userid=42
pandas_df: pd.DataFrame = catalog.entity.user.user_events_partitioned(userid="42").read()