As part of my Databricks learning journey, I explored the new Lakeflow Designer (Visual Data Prep) capability and built an end-to-end analytics pipeline without writing extensive code. Recently, I ...

It was a good reminder that tutorials age fast, and digging into the errors is the best way to actually learn how a platform works under the hood. Alongside the data engineering, I’m trying to stay ...

Databricks Spark Guide - Databricks-specific Spark documentation covering cluster management and Delta Lake integration. Spark By Examples - Community tutorials with PySpark and Scala code examples ...

A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.