Build machine learning solutions using Azure Databricks

Outline

• Explore Azure Databricks
  • Get started with Azure Databricks
  • Identify Azure Databricks workloads
  • Understand key concepts
  • Data governance using Unity Catalog and Microsoft Purview
  • Exercise - Explore Azure Databricks
  • Module assessment
• Use Apache Spark in Azure Databricks
  • Get to know Spark
  • Create a Spark cluster
  • Use Spark in notebooks
  • Use Spark to work with data files
  • Visualize data
  • Exercise - Use Spark in Azure Databricks
  • Module assessment
• Train a machine learning model in Azure Databricks
  • Understand principles of machine learning
  • Machine learning in Azure Databricks
  • Prepare data for machine learning
  • Train a machine learning model
  • Evaluate a machine learning model
  • Exercise - Train a machine learning model in Azure Databricks
  • Module assessment
• Use MLflow in Azure Databricks
  • Capabilities of MLflow
  • Run experiments with MLflow
  • Register and serve models with MLflow
  • Exercise - Use MLflow in Azure Databricks
  • Module assessment
• Tune hyperparameters in Azure Databricks
  • Optimize hyperparameters with Optuna
  • Review trials
  • Scale hyperparameter optimization
  • Exercise - Optimize hyperparameters for machine learning in Azure Databricks
  • Module assessment
• Use AutoML in Azure Databricks
  • What is AutoML?
  • Use AutoML in the Azure Databricks user interface
  • Use code to run an AutoML experiment
  • Exercise - Use AutoML in Azure Databricks
  • Module assessment
• Train deep learning models in Azure Databricks
  • Understand deep learning concepts
  • Train models with PyTorch
  • Distribute PyTorch training with TorchDistributor
  • Exercise - Train deep learning models on Azure Databricks
  • Module assessment
• Manage machine learning in production with Azure Databricks
  • Automate your data transformations
  • Explore model development
  • Explore model deployment strategies
  • Explore model versioning and lifecycle management
  • Exercise - Manage a machine learning model
  • Module assessment