Pipeline Patterns · Teaching
Essays on the mechanics underneath analytical data systems: storage, execution, modeling, correctness, and the tradeoffs that shape real work. New writing lands first on Substack.
By the end, you will understand how table formats actually work, where Iceberg, Delta, and Hudi actually differ, and when the lakehouse architecture earns its complexity versus when it doesn't.
By the end of this article you will be able to explain why columnar storage is a standard for analytical workloads.
By the end, you should be able to look at a BigQuery execution plan and tell a story about what the engine is doing in physical terms.
