What is... a Workflow?

The Workflows workspace UI provides entry to the Jobs and DLT (Delta Live Tables) Pipelines UIs, which are managed tools that allow you to orchestrate your notebooks for any ETL (Extract, Transform, Load), Analytics and ML workloads you might want to run.

Features:

Timeline
Visualisations for debugging
Triggers (based on file arrival patterns and table updates)
Integration with Git (allows us to run version-controlled code from the Sagacity Solutions Gitlab domain)
Branching & Looping
Parameters
Notifications
Integration with Orchestration Tools (i.e. Apache airflow)
DABs (Databricks Asset Bundles)