Databricks · Databricks Data Engineer Associate
Ingestion patterns and methods
Databricks Data Engineer Associate · Lesson 3 of 22 · 14:57
YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗
In this lesson
Prepare for the Databricks Certified Data Engineer Associate exam. In this lesson: batch, incremental, and streaming ingestion patterns, Lakeflow Connect managed connectors, uploading local files and partner integrations, and how to choose the right method among COPY INTO, Auto Loader, Lakeflow Connect, and Lakehouse Federation. Includes three original practice questions.
Preview the topics
- Hollowbrook wants its Salesforce accounts and opportunities in Unity Catalog every hour, with schema changes handled for it, and no custom code to maintain. Which option fits?
- Once a month, a supplier sends a small CSV file of promotional prices. An analyst needs it as a table today, with no pipeline to build. What is the simplest way?
- Freezer sensors in every store publish temperature readings to Kafka, and the alert team needs them in a Delta table within seconds. Which ingestion approach fits?