Microsoft · DP-750
Batch and CDC ingestion
DP-750 · Lesson 10 of 19 · 1:17:34
YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗
In this lesson
Prepare for the DP-750 exam (Microsoft Certified: Azure Databricks Data Engineer Associate). In this lesson: Lakeflow Connect pipelines, gateways, and SCD types, spark.read, JDBC, and write modes, readStream and writeStream with checkpoints, CREATE TABLE AS SELECT, CREATE OR REPLACE TABLE, COPY INTO, and change data capture feeds with the AUTO CDC API. Includes three original practice questions.
Preview the topics
- A notebook writes each night’s CRM extract with saveAsTable, and the second run fails because the table already exists. The table must keep the rows of every night. Which write mode fits?
- The billing partner drops new CSV files into a volume every night, and a scheduled SQL task must load only the new files into an existing table, even if it runs twice. What should the task run?
- Customer change events arrive with an operation type and a sequence number, sometimes out of order. The silver table must keep only the current version of each customer, with deletes applied. What should the team build?