Hands-On Exercise
— Streaming Pipeline
OPTIONAL
1
Databricks Streaming
Structured Streaming from Kafka
Bronze → Silver (watermarks)
Gold (windowed aggregations)
2
Snowflake Dynamic Tables
Relay consumer to ADLS2
Dynamic Tables with target lag
Auto-refresh incremental pipeline
3
Live Dashboard
Power BI DirectQuery connection
1-minute auto-refresh
3 visuals: bar, card, line chart
