A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.

Download Delta Lake to add reliable ACID transactions, scalable metadata handling, and unified batch and streaming workflows to your data lake. Build versioned tables, enforce schemas, and power ...

As part of my Databricks learning journey, I explored the new Lakeflow Designer (Visual Data Prep) capability and built an end-to-end analytics pipeline without writing extensive code. Recently, I ...

Over the years, I’ve noticed a common challenge among aspiring and experienced Data Engineers: Most people learn Databricks and Spark concepts in fragments. One course explains Spark basics. Another ...