ornladios / ALACRITY-ADIOS

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ALACRITY for ADIOS, a fork of ALACRITY from North Carolina State University

===============Install ALACRITY=========================== DEPENDENCES: ===gcc 4.8.2 ===automake 1.11.1 autoconf 2.69, and libtool 2.6.2b You can download them from links below http://ftp.gnu.org/gnu/automake/ http://ftp.gnu.org/gnu/autoconf/ https://ftp.gnu.org/gnu/libtool/

  1. Build ALACRITY [git@github.com:ornladios/ALACRITY-ADIOS.git] 1.1 cd [ALACRITY PATH] 1.2 ./autogen.sh 1.2 Copy ./runconf to ./myrunconf 1.3 Edit ./myrunconf, setting the paths for timer and indexcompression, and your output build path 1.4 Run ./myrunconf

==============Index & Query ============================

  1. Build Index: 1.1 cd [alacrity install path] 1.2 The executable file 'alac' is the command we need. It has following arguments ( type ./build/bin/alac, we can see the detail usage): 'encode': indicates to indexing the data -p : partition size, we can specify total size or total element number -i | -x : the format of index, -i means the inverted index, but -x means the compressed inverted index -s[Number] : the number of bits it will use [input data path] [output data path] : this path require a prefix of the files the alarity will produce For example, if we want to build compressed inverted indexes for 2GB double temp precision data by binning 16 significant bits $ ./build/bin/alac encode -p268435456E -x -edouble -s16 ~/sigmod_2012_2GB/temp ~/data/ii_index/s3d/1part_2G/pfd/temp Using partition size of 268435456(not accounting for element size, but WILL later) Using legacy format n Encoding complete, 2147483648 bytes of input data successfully encoded into 1 partitions

  2. Perform Query: 2.1 cd [alacrity install path] 2.2 The executable file 'uniquery' is the command we need. It has following arguments ( type ./build/bin/uniquery, we can see the detail usage): [input data base path]: the path is the output path of the indexing stage [low boundary value] [high boundary value] For example, if we want to query the temp data is between 35.65 and 663.6, we do: $ ./build/bin/uniquery ~/data/ii_index/s3d/1part_2G/pfd/temp 35.65 663.6 Total results: 11041898 (4.1134% selectivity, 1/1 partitions had results) uniquery avg. time 0.261354

===============ASSUMPTIONS=========================================

  1. ALACRITY supports at most 2GB partition data size.
  2. The output of ALACRITY query does not output all RIDs.

About

License:Other


Languages

Language:C++ 57.6%Language:C 20.6%Language:Shell 19.2%Language:TeX 1.9%Language:Gnuplot 0.3%Language:Makefile 0.2%Language:M4 0.2%Language:Io 0.0%Language:Awk 0.0%Language:Objective-C 0.0%