From the course: MLOps with Databricks
Join today to access over 24,900 courses taught by industry experts.
Getting started with DABs - Databricks Tutorial
From the course: MLOps with Databricks
Getting started with DABs
- [Instructor] You may have noticed that the repository contains databricks.yml file which was set up when configuring DB Connect. It's there for a reason. This file is required to deploy jobs on Databricks via Databricks asset bundles. If you have ever worked with Databricks and try to automate things, you have noticed that there are multiple ways to deploy Databricks jobs with all of the dependencies. Terraform, Databricks APIs and Databricks asset bundles. If you use Terraform or Databricks API, you need to take care of a lot of things. If you want to execute a Python script, that's called a main.py, that requires a project_config.yml file. You must ensure all the files are uploaded to the workspace of volumes before the job is deployed and that the location of these files is referenced in the job definition. Databricks Asset Bundle helps you manage those dependencies. It uploads all the files that belong to the project, to a path in the workspace, which can be defined by the…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.