Project
BigQuery transformations with dbt, Airflow and Kubernetes
Automated BigQuery transformation workflow using dbt, Airflow, Kubernetes and GitHub Actions.
- Context
- Public data engineering project documented on Medium.
- Problem
- BigQuery transformations need repeatable orchestration, containerized execution and clear deployment flow.
- Solution
- Built a dbt pipeline executed from Airflow on Kubernetes, with Docker packaging and GitHub Actions for image delivery.
- Impact
- Shows orchestration, containerization and transformation design across a modern analytics stack.
Stack
GCPBigQuerydbtAirflowKubernetesGitHub Actions
Links
This is listed as a project because it includes a public repository and a reproducible orchestration workflow.