Cert EspressoLearn. Practise. Find your flow.

A LITTLE FOCUS.
A BIG NEXT STEP.

Your pace. Your space.
Microsoft · DP-750

Data quality

DP-750 · Lesson 14 of 19 · 1:41:45

YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗

In this lesson

Prepare for the DP-750 exam (Microsoft Certified: Azure Databricks Data Engineer Associate). In this lesson: NOT NULL and CHECK constraints, uniqueness tests, schema enforcement, cast and try_cast with a quarantine table, schema drift with Auto Loader modes, mergeSchema, and MERGE WITH SCHEMA EVOLUTION, and pipeline expectations that warn, drop, or fail. Includes three original practice questions.

Preview the topics
  • A bronze column of readings sometimes holds text like “N/A” instead of a number. The load must keep processing the valid rows, and keep the invalid ones for review. What should the team implement?
  • A nightly batch append now fails, because the source added a phone number column. The team agrees to add new columns automatically to this table. What should it change?
  • Readings with negative kilowatt hours must never reach the silver table, but the pipeline must keep running when they appear. Which expectation action fits?