Skip to content
Rafael Vera Marañón Senior Data Engineer & Data Architect

Project

Selective rebuild by Lineage BFS on Databricks

Databricks Free Edition POC for rebuilding only the minimum upstream lineage branch required for a Gold view.

Selective rebuild by Lineage BFS on Databricks
Context
Public Databricks Free Edition project documented on Medium.
Problem
When a Gold view has a data quality defect, rebuilding every upstream object is noisy and inefficient.
Solution
Built a reproducible lineage-based workflow that fixes the upstream cause and rebuilds only the selected branch needed for the affected Gold object.
Impact
Shows selective recovery, lineage reasoning and repeatable platform automation in a compact Databricks POC.

Stack

DatabricksPythonDatabricks Asset BundlesUnity CatalogLineage

Links