gayankanishka / olist-ecommerce-analytics-api

A RESTful API to expose big data analytics on Olist E-Commerce data.

Olist Ecommerce Analytics API

A RESTful API to expose big data analytics on Olist E-Commerce data. Big data analytics were processed using Apache hadoop deployed on Azure. This module is only responsible for exposing the results which are stored in Azure Blob Storage. This was done as a part of a MSc module project.

High-level architecture diagram

Repository contains only the Analytics API module

What's included:

• .NET 5.0
• MediatR
• CsvHelper
• Azure Blob Storage
• Swagger
• WebHDFS

Table of Content

• Quick Start
  • Prerequisites
  • Development Environment Setup
  • Build and run
• License

Quick Start

After setting up your local DEV environment, you can clone this repository and run the solution. Make sure all the other interconnected services are running on the cloud.

Prerequisites

You'll need the following tools:

• .NET, version >=5
• Visual Studio, version >=2019 or JetBrains Rider, version >=2020
• AzureStorageEmulator or Azurite
• Azure Storage Explorer

Development Environment Setup

First clone this repository locally.

• Install all of the the prerequisite tools mentioned above.

Build and run from source

With Visual studio: Open up the solutions using Visual studio.

• Restore solution nuget packages.
• Rebuild solution once.
• Run the solution.
• Local swagger URL here.

License

Licensed under the MIT license.