CloudFrontLog
convert CloudFrontLogs , short them.
install
git clone https://github.com/funami/CloudFrontLog
cd CloudFrontLog
npm install
usage
Usage: conv.js [options]
Options:
-h, --help output usage information
-V, --version output the version number
-s, --start [start time YYYYMMDDHHmmSS] Specified start time [YYYYMMDDHHmmSS]
-e, --end [end time YYYYMMDDHHmmSS] Specified end time [YYYYMMDDHHmmSS]
-i, --id [id] Specified id [id]
prepare
download cloud flont log files and gunzip
take user agent and date time
pick a custom id from url and print short user agent and date time
cat [cloud flont files] | ./conv.js
filter it by custome id
cat [cloud flont files] | ./conv.js -s 201402010000 -e 201402020000 -i 100
example
you can test it with test data.
$ cat spec/testdata/E2WAP9S9SFKN6O.2014-02-07-11.i0vnmDwB |./conv.js
191 IE_10/Windows_7 2014-02-07 11 20140207110337
33 IE_9/Windows_Vista 2014-02-07 11 20140207110328
54 Mobile_Safari_7/iOS_7 2014-02-07 11 20140207110345
$ cat spec/testdata/E2WAP9S9SFKN6O.2014-02-07-11.i0vnmDwB |./conv.js -s 20140207110329 -e 20140207110344
191 IE_10/Windows_7 2014-02-07 11 20140207110337
$ cat spec/testdata/E2WAP9S9SFKN6O.2014-02-07-11.i0vnmDwB |./conv.js -i 54
54 Mobile_Safari_7/iOS_7 2014-02-07 11 20140207110345