Microsoft · DP-750
Design data pipelines
DP-750 · Lesson 15 of 19 · 1:57:18
YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗
In this lesson
Prepare for the DP-750 exam (Microsoft Certified: Azure Databricks Data Engineer Associate). In this lesson: the order of operations through the medallion layers, notebooks or Lakeflow Spark Declarative Pipelines, task dependencies and Run if conditions, If/else and For each tasks, job parameters, and error handling with expectations, retries, timeouts, notifications, and exceptions. Includes three original practice questions.
Preview the topics
- The redesigned billing ETL runs every night with standard ingestion and transformations, and needs built-in quality checks, lineage, and retries, with little orchestration code. What should the team build?
- A cleanup task must run after the three load tasks finish, whether they succeed or fail. Which Run if condition should it use?
- A task that calls a partner’s API sometimes times out, and succeeds on the next attempt, yet the on-call team receives an email for every attempt. What should the team configure?