Building Medallion Architectures: Designing with Delta Lake and Spark (1)

By: Piethein Strengholt

Sign Up Now! Already a Member? Log In
You must be logged into Bookshare to access this title. Learn about membership options, or view our freely available titles.

Synopsis: To deliver the insights that give them a competitive advantage, organizations increasingly turn to the proven Medallion architecture. Yet implementing a robust data architecture can be difficult, particularly when it comes to using the Medallion architecture's Bronze, Silver, and Gold layers—done wrong, it can hamper your ability to make data-driven decisions. This practical guide helps you build a Medallion architecture the right way with Azure Databricks and Microsoft Fabric. Drawing on hands-on experience from the field, Piethein Strengholt demystifies common assumptions and complex problems you'll face when embarking on a new data architecture. Architects and engineers of all stripes will find answers to the most typical questions along with insights from real organizations about what's worked, what hasn't, and why. You'll learn: Learn how to build a Medallion architecture with Azure Databricks and Microsoft Fabric Gain insights from three real case studies that illustrate practical field experience and lessons learned Explore scaling considerations, including governance, security, generative AI, and more Make informed decisions when designing or implementing new data architectures Get proven patterns for success that align with broader organizational objectives