%pip install dbdemos
import dbdemos
dbdemos.install('streaming-sessionization')
Try this demo in your workspace!
Run the following in your notebook:
License | Notice
databricks-logo

Spark Streaming - Advanced

Deep dive on Spark Streaming with Delta to build webapp user sessions from clicks, with custom aggregation state management.
01-Delta-session-BRONZE
Save kafka events in a Delta Lake table and start analysis.
02-Delta-session-SILVER
Clean events and remove duplicate in the Silver layer.
03-Delta-session-GOLD
Compute sessions with applyInPandasWithState and upsert (MERGE) output to sessions table.
_00-Delta-session-PRODUCER
Simulate user events on website
scala
01-Delta-session-BRONZE-scala
Save kafka events in a Delta Lake table and start analysis.
02-Delta-session-SILVER-scala
Clean events and remove duplicate in the Silver layer.
03-Delta-session-GOLD-scala
Compute sessions in scala using flatMapGroupsWithState.