From the course: Microsoft Azure Data Scientist Associate (DP-100) Exam Tips

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

Distributed deep learning

Distributed deep learning - Azure Tutorial

From the course: Microsoft Azure Data Scientist Associate (DP-100) Exam Tips

Start my 1-month free trial Buy for my team

Distributed deep learning

“

- [Instructor] Deep learning is the class of machine learning that uses multiple layers to extract high-level features from the raw input. For example, in image processing, lower layers may identify edges, while higher layers may identify digits or letters. Azure Databricks supports Uber's Horovod framework to run distributed deep learning training jobs on Spark. In order to learn how to distribute deep learning in Azure Databricks with HorovodRunner, you need to understand what Horovod is and how it can help distribute your deep learning models. All this is found in this section. Since deep learning models contain layers that need to be processed sequentially, and use intermediary results to improve the model, the parallel processing of deep learning models can quickly become complicated. Horovod is designed to take care of the infrastructure management so that data scientists can focus on training models. Horovod…

Contents