Databricks · Databricks Data Engineer Associate
From bronze to silver
Databricks Data Engineer Associate · Lesson 8 of 22 · 53:54
YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗
In this lesson
Prepare for the Databricks Certified Data Engineer Associate exam. In this lesson: cleaning data from the bronze layer to the silver layer: casting data types, handling null values, and writing the silver table. Includes three original practice questions.
Preview the topics
- The bronze sales table stores each price as a string, and a few rows hold the word unknown. The nightly job must convert prices to DECIMAL without failing on those rows. What should it use?
- In the bronze loyalty table, the member ID is the key of the silver table, and the points column is sometimes empty, where empty means zero points. Which cleaning fits both columns?
- A nightly job rebuilds the silver sales table from all of bronze, with saveAsTable in append mode, and the silver row count doubles every night. What should the data engineer change?