Databricks · Databricks Data Engineer Associate
Semi-structured and unstructured data
Databricks Data Engineer Associate · Lesson 7 of 22 · 38:04
YouTube loads only after you press play. This chapter opens at its timestamp in the full course. Watch on YouTube ↗
In this lesson
Prepare for the Databricks Certified Data Engineer Associate exam. In this lesson: semi-structured and unstructured data, nested JSON (from_json, dot notation, and explode), the VARIANT type and variant_get, and unstructured files such as images and PDFs in volumes. Includes three original practice questions.
Preview the topics
- The bronze table has a string column that holds each event as JSON, and the silver table needs the member tier as its own typed column. Which function parses the string into a struct?
- Partners send device telemetry as JSON, and each device model adds fields of its own every month. The team wants to store every event without managing a schema, and still query a few fields. What should they store?
- Hollowbrook wants every supplier PDF spec sheet in a Delta table, one row per file, with its path and its content, so that a later job can pull out the text. Which approach fits?