S2:E14

Metric Views in Databricks: The Missing Layer for AI Agents

Data PlatformAI
43 min

Host

Jonny DaenenJonny Daenen

Guest

Stefan Van RaemdonckStefan Van Raemdonck

AI is only as good as the layer underneath it. That layer in Databricks is called a Metric View: a semantic model that defines your measures, your joins, and the rules for how data fits together.

In this episode, Stefan walks through the full stack end-to-end on a real LEGO dataset: building Metric Views in Databricks, generating them with dbt, deploying through Databricks Asset Bundles, and finally exposing it all through a Genie Space that business users can chat with. Along the way we get into some deeper questions: what the limits of metric views look like, how access control works, what BI "shifting left" actually means for engineering teams, and how you organize this in data products.

If you saw our Snowflake Intelligence episode, this is the Databricks counterpart. The Snowflake episode can be found here: www.youtube.com/watch?v=Gp-BntPgpcU

Read transcript →

Chapters

  1. 00:00Intro
  2. 00:50Meet Stefan
  3. 01:43Demo: talking to your LEGO data
  4. 07:17Why semantic layers? Data products explained
  5. 11:20What's in a metric view?
  6. 14:15Creating Metric Views in Databricks
  7. 16:29The LEGO data model
  8. 18:17Data Products & Metric Views in Databricks
  9. 22:07Are we limited to predefined measures?
  10. 23:16Building: native Databricks SQL bundles
  11. 29:12Building: dbt
  12. 31:16Maintenance and BI shifting left
  13. 33:59Deploying dbt on Databricks
  14. 35:29Creating the Genie Space
  15. 38:24Access Control and Permissions in Data Queries
  16. 39:28Writing SQL on top of Metric Views
  17. 40:10Takeaways and favorite Lego

Tags

DatabricksMetric ViewsTalk To DataGenie Spaces