presto-hyperloglog
Algebird's HyperLogLog support for Facebook Presto (prestodb.io).
Functions
There are two types of functions, aggregation and scalar.
Aggregation
merge(<hll: HLL>) -> HLL
Scalar
hll_create(<element:VARCHAR>, <bits: BIGINT>) -> HLL
cardinality(<hll: HLL>) -> BIGINT
Building
As this is a Presto plugin it relies on presto-spi. This means you will have to build Presto first and this project expects to find Presto as a parent project.
/presto/
/presto/presto-main
/presto/presto-hyperloglog
Then run mvn clean install in /presto. Once that has finished run mvn clean install in /presto/presto-hyperloglog.
Finally add the plugin to /presto/presto-main/etc/config.properties.
Deployment on AWS EMR
The uber jar is now built by maven.
mkdir /usr/lib/presto/plugin/presto-hyperloglog
cd /usr/lib/presto/plugin/presto-hyperloglog
sudo wget https://github.com/vitillo/presto-hyperloglog/raw/master/target/presto-hyperloglog-$PRESTO_VERSION-jar-with-dependencies.jar