ardbramantyo / cpidatawarehouse

Embark on the CPI Card Group's comprehensive data warehouse venture. From schema design and table creation to Pentaho integration and advanced SQL analytics, witness dynamic BI dashboards that empower strategic decisions.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

End-to-End Enterprise Data Warehouse Development for CPI Card Group

Company Overview

CPI Card Group is a prominent figure in the payment card production realm, boasting over three decades of expertise. Their global presence and allegiance to leading payment brands underscore their significance. From VISA to MasterCard, American Express, Discover, and Interac, CPI's repertoire includes a diverse array of consumer plastic cards, including cutting-edge contactless smart cards. Anchored by a secure production network spanning North America, CPI stands as a go-to for financial institutions and prepaid debit card programs alike.

Business Problem

Within their triumphant journey, CPI faces the complex intricacies of their operations. A labyrinthine manufacturing process intertwines with data from ERP, CRM, and finance, resulting in reporting bottlenecks. The reliance on IT for reports hampers swift decision-making. In response, CPI seeks a robust data warehouse solution to streamline operations and catapult them into a future-ready stance.

Proposed Scenario for Data Warehouse Solution:

Data Collection

  • Extract comprehensive data from the Enterprise Resource Planning (ERP), covering card production, sales, and financials.
  • Source marketing data from the marketing department, including leads, quotes, and success rates.
  • Collect financial data from the accounting department, encompassing costs, invoices, and sales summaries.

image

Picture 1. Data Sources at the CPI Card Group Data Warehouse

Data Modeling

  • Design a constellation schema ERD for the data warehouse.
  • Identify key dimensions like time, location, sales class, and customers, anchoring them to a central fact table capturing holistic business metrics.

image

Picture 2. ERD Design for CPI Card Group

ETL Process with Pentaho

  • Utilize Pentaho Data Integration for seamless ETL processes. image

Picture 3. Integration scenario

  • Extract, transform, and load marketing data into the central fact table, ensuring data consistency and accuracy. image

Picture 4. Data Integration process with Pentaho

Advanced Analytical Queries

  • Develop view tables for revenue, job summarization insights.
CREATE VIEW view_location_invoice_revenue_summary AS
SELECT
     A.location_id
    ,E.location_name
    ,F.time_year AS contract_year
    ,F.time_month AS contract_month
    ,A.job_id
    ,A.unit_price
    ,A.quantity_ordered
    ,SUM(D.invoice_amount) AS sum_invoice_amount
    ,SUM(D.invoice_quantity) AS sum_invoice_quantity
FROM w_job_f A
JOIN w_sub_job_f B ON A.job_id = B.job_id
JOIN w_job_shipment_f C ON B.sub_job_id = C.sub_job_id
JOIN w_invoiceline_f D ON C.invoice_id = D.invoice_id
JOIN w_location_d E ON A.location_id = E.location_id
JOIN w_time_d F ON A.contract_date = F.time_id
GROUP BY
    A.location_id
   ,E.location_name
   ,F.time_year
   ,F.time_month
   ,A.job_id
   ,A.unit_price
   ,A.quantity_ordered
ORDER BY
    A.location_id
   ,F.time_year
   ,F.time_month
   ,A.job_id;

image

Picture 5. Rank locations by sum of business days delayed for the job shipped by date

  • Analyze trends over time using Analytical queries.
SELECT
     A.location_name
    ,B.time_year AS year_of_date_ship_by
    ,SUM(A.days_diff_first_shipment_ship_by)
    ,RANK() OVER(PARTITION BY A.location_name ORDER BY SUM(A.days_diff_first_shipment_ship_by) DESC) AS rank
FROM view_first_shipment_delays_involving_shipped_by_date A
JOIN w_time_d B ON A.date_ship_by = B.time_id
GROUP BY A.location_name, year_of_date_ship_by;

image

Picture 6. Location invoice revenue summary

  • Evaluate financial performance, gross margins, and profitability by location and product.
SELECT
     A.location_name
    ,A.contract_year
    ,A.contract_month
    ,ROUND(SUM((A.sum_invoice_amount - B.sum_total) / A.sum_invoice_amount), 2) AS profit_margin
    ,RANK() OVER(PARTITION BY A.location_name, A.contract_year ORDER BY SUM(A.sum_invoice_amount - B.sum_total) DESC) AS rank
FROM
    view_location_invoice_revenue_summary A
JOIN
    view_location_subjob_cost_summary B ON A.job_id = B.job_id
GROUP BY
     A.location_name
    ,A.contract_year
    ,A.contract_month;

image

Picture 7. Rank locations by descending annual profit margin

MicroStrategy Dossier Creation

  • Use MicroStrategy to craft advanced dashboards.
  • Develop interactive visualizations highlighting key performance indicators, revenue trends, and cost breakdowns.
  • Include drill-down features for detailed analysis. image

Picture 7. Job and Shipment Trend Dashboard

image

Picture 8. Invoice Trend Dashboard

image

Picture 9. Financial Performance Dashboard

Actionable Outputs

  • Identify high-performing sales agents and locations for targeted strategies.
  • Optimize production timelines by analyzing production and shipment trends.
  • Improve financial forecasting based on cost variations and challenging-to-budget products.

Benefits for the Company

  • Improved Decision-Making: Enable business analysts for informed decisions with self-service reporting, responding rapidly to market changes.
  • Cost Optimization: Identify cost-effective machine types and streamline production based on historical data, reducing operational expenses.
  • Enhanced Sales Strategies: Target marketing efforts effectively based on historical data, aligning with successful leads and converted jobs.
  • Scalability and Future Growth: Design a scalable solution for growing data volumes and reporting needs, positioning for future growth.
  • User Empowerment: Empower business analysts with self-service reporting tools and user-friendly dashboards, reducing IT reliance.
  • Strategic Insights: Provide executives with strategic insights into market trends, customer preferences, and industry benchmarks.

Conclusion

This end-to-end solution positions CPI Card Group to wield the power of data strategically, optimizing costs, fostering growth, and making informed decisions in the competitive payment industry. The tangible benefits, coupled with user-friendly dashboards, align seamlessly with CPI's strategic objectives.

Accomplishment

The above project is a Capstone project to get the Data Warehousing for Business Intelligence Specialization certification and to complete the mastery of using MicroStrategy, the author took and passed 2 MicroStrategy certifications: Departmental Analyst and Enterprise Analyst.

About

Embark on the CPI Card Group's comprehensive data warehouse venture. From schema design and table creation to Pentaho integration and advanced SQL analytics, witness dynamic BI dashboards that empower strategic decisions.

License:MIT License