microsoft partner logo color
8420  Reviews star_rate star_rate star_rate star_rate star_half

Implement a data engineering solution with Azure Databricks

Important This course will be available 8/15/25 Learn how to harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run large data engineering workloads...

Read More
By Request
Contact Us For Pricing
Duration 1 day
Course Code DP-3027
Available Formats Classroom

Overview

Important

This course will be available 8/15/25

Learn how to harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run large data engineering workloads in the cloud.

Audience Profile

Data Engineers, Data Scientists, ELT Developers learn how to harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run large data engineering workloads in the cloud.

Course Details

Outline

  • Perform incremental processing with spark structured streaming
    • Set up real-time data sources for incremental processing
    • Optimize Delta Lake for incremental processing in Azure Databricks
    • Handle late data and out-of-order events in incremental processing
    • Monitoring and performance tuning strategies for incremental processing in Azure Databricks
    • Exercise - Real-time ingestion and processing with Delta Live Tables with Azure Databricks
    • Module assessment
  • Implement streaming architecture patterns with Delta Live Tables
    • Event driven architectures with Delta Live tables
    • Ingest data with structured streaming
    • Maintain data consistency and reliability with structured streaming
    • Scale streaming workloads with Delta Live tables
    • Exercise - end-to-end streaming pipeline with Delta Live tables
    • Module assessment
  • Optimize performance with Spark and Delta Live Tables
    • Optimize performance with Spark and Delta Live Tables
    • Perform cost-based optimization and query tuning
    • Use change data capture (CDC)
    • Use enhanced autoscaling
    • Implement observability and data quality metrics
    • Exercise - optimize data pipelines for better performance in Azure Databricks
    • Module assessment
  • Implement CI/CD workflows in Azure Databricks
    • Implement version control and Git integration
    • Perform unit testing and integration testing
    • Manage and configure your environment
    • Implement rollback and roll-forward strategies
    • Exercise - Implement CI/CD workflows
    • Module assessment
  • Automate workloads with Azure Databricks Jobs
    • Implement job scheduling and automation
    • Optimize workflows with parameters
    • Handle dependency management
    • Implement error handling and retry mechanisms
    • Explore best practices and guidelines
    • Exercise - Automate data ingestion and processing
    • Module assessment
  • Manage data privacy and governance with Azure Databricks
    • Implement data encryption techniques in Azure Databricks
    • Manage access controls in Azure Databricks
    • Implement data masking and anonymization in Azure Databricks
    • Use compliance frameworks and secure data sharing in Azure Databricks
    • Use data lineage and metadata management
    • Implement governance automation in Azure Databricks
    • Exercise - Practice the implementation of Unity Catalog
    • Module assessment
  • Use SQL Warehouses in Azure Databricks
    • Get started with SQL Warehouses
    • Create databases and tables
    • Create queries and dashboards
    • Exercise - Use a SQL Warehouse in Azure Databricks
    • Module assessment
  • Run Azure Databricks Notebooks with Azure Data Factory
    • Understand Azure Databricks notebooks and pipelines
    • Create a linked service for Azure Databricks
    • Use a Notebook activity in a pipeline
    • Use parameters in a notebook
    • Exercise - Run an Azure Databricks Notebook with Azure Data Factory
    • Module assessment
Read Less

Schedule

Upcoming Course Dates

There are currently no scheduled dates for this course. If you are interested in this course, contact us with the form below.

Contact Information
Ascendient Learning would like to occasionally share news about our services and career opportunities via e-mail when we believe it would be relevant to you. Would you like to opt-in to these communications? You may withdraw your consent at any time using the opt-out/preferences link in the emails sent.

FAQ

How do I get a Microsoft exam voucher?

Pearson Vue Exam vouchers can be requested and ordered with your course purchase or can be ordered separately by clicking here.

  • Vouchers are non-refundable and non-returnable. Vouchers expire 12 months from the date they are issued unless otherwise specified in the terms and conditions.
  • Voucher expiration dates cannot be extended. The exam must be taken by the expiration date printed on the voucher.

Do Microsoft courses come with post lab access?

Most Microsoft official courses will include post-lab access ranging from 30 to 180 calendar days after instructor led course delivery. A lab training key in class will be provided that can be leveraged to continue connecting to a remote lab environment for the individual course attendee.

Does the course schedule include a Lunchbreak?

Lunch is normally an hour-long after 3-3.5 hours of the class day.

What languages are used to deliver training?

Microsoft courses are conducted in English unless otherwise specified.

Reviews

Great class I learned a great deal from the material. There would seem to a large amount that I need to learn about.

Good course. I appreciate the time the instructor put into teaching this class.

Very good material, the instructor was clear explaining the topics, and the labs were easy to follow it.

I like their training. A lot of material covered. The labs are very good. l learned a lot.

my experince was great from the day i regetered to the actuall day of the class.