Microsoft · DP-750
Profile and cleanse data
DP-750 · Lesson 12 of 19 · 1:30:14
YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗
In this lesson
Prepare for the DP-750 exam (Microsoft Certified: Azure Databricks Data Engineer Associate). In this lesson: ANALYZE TABLE, data profiling, and anomaly detection, choosing column data types, finding and removing duplicates with QUALIFY and ROW_NUMBER, handling nulls with dropna, fillna, and COALESCE, and filtering, grouping, and aggregating. Includes three original practice questions.
Preview the topics
- Invoice amounts, in dollars and cents, must add up exactly to the cent in every report. Which type should the amount column use?
- The customers table holds several rows per customer ID, with different update times, and only the most recent row of each customer must remain. What should the team use?
- A report must list only the regions whose total consumption for the month exceeds one gigawatt hour. Where does the condition on the total belong?