Production data platform powering Various dashboards, reporting, and integrations**.
Built on Laravel, Supabase, Prefect, and external APIs to provide reliable, auditable business data.
- Overview
- Architecture
- Tech Stack
- Repository Structure
- Core Features
- ETL Pipelines
- Dashboards
- Integrations
The ABC Data Platform centralizes operational, financial, and project data from multiple systems into a single source of truth used for:
- Executive dashboards
- Pipeline & profitability tracking
- Contract and invoice reporting
- KPI monitoring
The system is designed for data accuracy, auditability, and scalability.
-External Systems -(Google Sheets, Fieldwire, QBO) ↓ ETL / Sync Layer (Prefect + Python) ↓ Snowflake ↓ dbt (Transformation) ↓ Supabase (PostgreSQL) ↓ Laravel Application ↓ Dashboards & Admin UI
- Laravel (PHP)
- Supabase (PostgreSQL)
- Prefect (ETL orchestration)
- Python (ETL & integrations)
- Blade Templates
- DataTables
- Chart.js / ApexCharts
- Select2 / Flatpickr
-
Google Sheets API
-
Fieldwire API
-
Supabase REST API
-
Contract master data management
-
Pipeline tracking
-
Profitability analysis
-
KPI dashboard customization (per user)
-
Rate management
-
User & access management
-
Webhook-based task updates
- Flow name:
contracts-sync - Source: Google Sheets (PLPA Master → Contracts tab)
- Target: Supabase table
Contract
Behavior
- Full refresh
- Preserves manual records (
is_custom = 1) - Batch inserts via Supabase REST API
- Optional CSV snapshot for auditing
Transformations
- Header normalization
- Data validation & cleaning
- Numeric coercion
- UTC upload timestamps
ETL scripts are located under /etl.
- Pipeline
- Profitability
- Rates
- Users
- KPI Library
- User-specific KPI selection
- Layouts stored in
kpi_layouts - Persisted per dashboard tab
- OAuth authentication
- Primary source for contract master data
- Webhook-based task updates
- Task → contract linkage
- Status & completion tracking
- PHP 8.x
- Composer
- Node.js
- Python 3.10+
- Supabase project access