Databricks · Databricks Data Engineer Associate
COPY INTO
Databricks Data Engineer Associate · Lesson 4 of 22 · 20:37
YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗
In this lesson
Prepare for the Databricks Certified Data Engineer Associate exam. In this lesson: the COPY INTO command, idempotent loading that skips the files already loaded, file formats, patterns, and format options, schema options (inferSchema and mergeSchema), reloading every file with force, and checking files with VALIDATE before loading. Includes three original practice questions.
Preview the topics
- Last night, COPY INTO loaded 200 store files into the bronze sales table. This morning, 100 more files have arrived in the same folder, and the engineer runs the same command again. What happens?
- The stores' new software adds a loyalty ID column to the sales files, and the nightly COPY INTO must add that column to the sales table automatically. Which option should the engineer set?
- An engineer deleted last week's rows by mistake, and the source files are still in the folder. COPY INTO must load last week's files again, and nothing else. What must the engineer add?