filipyoo / nyc-taxi-analysis

Analyzing 200 GB of NYC taxi dataset.

How to handle 200 GB of data with AWS EC2 Hadoop cluster

http://www.filipyoo.com/handle-200-GB-of-data-with-AWS-EC2-hadoop-cluster/

Storing 200 GB of NYC taxi dataset and deploying a Cloudera Hadoop cluster to visualize it.

Plot and visualization of Hadoop large dataset with Python Datashader

http://www.filipyoo.com/plot-visualization-Hadoop-large-dataset-with-python-datashader/

Visualization without Datashader

Workflow overview

Using Datashader

Final visualization