I built an end-to-end batch data pipeline from scratch. Here's what I designed, broke, fixed, and actually understood and more importantly, why every decision was deliberate. Most pipelines break ...