ETL Data Pipeline Development using Streamlit on GCP

Project Overview

To manage enterprise data for Reporting and Analytics, the client wants to set up an ETL pipeline. Analysis of Sales performance, Supply chain and Stock management, Credit Services, and Delivery agent activity should be driven by the ETL solution.

About Client

The Client is an African retail supply chain transformation company enabling small shops and retailers to adopt the digital economy through mobile ordering & distribution systems, and enterprise services. The client holds a large B2B eCommerce network across Africa.

Business Requirements

Indium developed a solution to set up an ETL pipeline to manage enterprise data for Reporting and Analytics. The ETL solution will drive analysis of Sales performance, Supply chain and Stock management, Credit Services, and monitor Delivery agent’s activities.

1. Build and manage the entire ETL (Extraction, Transformation & Loading) data pipeline and ETL integration with the client’s existing ERP system, FMCG process, and Loan application process.
2. Develop Reports and Analytics to monitor Delivery agent’s performance, Vehicle Utilization, Credit Services, and Sales activities.
3. The transition of existing environment (Java & Postgres) to Big data platform.