Perform data science with Azure Databricks

In this module, you will:

• Understand the Azure Databricks platform
• Create your own Azure Databricks workspace
• Create a notebook inside your home folder in Databricks
• Understand the fundamentals of Apache Spark notebook
• Create, or attach to, a Spark cluster
• Identify the types of tasks well-suited to the unified analytics engine Apache Spark

In this module, you will:

• Understand the architecture of an Azure Databricks Spark Cluster
• Understand the architecture of a Spark Job

In this module, you will:

• Use Azure Databricks to read multiple file types, both with and without a Schema.
• Combine inputs from files and data stores, such as Azure SQL Database.
• Transform and store that data for advanced analytics.

In this module, you will:

• Use the count() method to count rows in a DataFrame
• Use the display() function to display a DataFrame in the Notebook
• Cache a DataFrame for quicker operations if the data is needed a second time
• Use the limit function to display a small set of rows from a larger DataFrame
• Use select() to select a subset of columns from a DataFrame
• Use distinct() and dropDuplicates to remove duplicate data
• Use drop() to remove columns from a DataFrame

In this module, you will learn how to:

• Write User-Defined Functions
• Perform ETL operations using User-Defined Functions

In this module, you will:

• Learn about the key features and use cases of Delta Lake.
• Use Delta Lake to create, append, and upsert tables.
• Perform optimizations in Delta Lake.
• Compare different versions of a Delta table using Time Machine.

In this module, you will learn how to:

• Perform Machine Learning
• Train a model and create predictions
• Perform exploratory data analysis
• Describe machine learning workflows
• Build and evaluate machine learning models

In this module, you will learn how to:

• Perform featurization of the dataset
• Finish featurization of the dataset
• Understand Regression modeling
• Build and interpret a regression model

In this module, you will learn how to:

• Use MLflow to track experiments, log metrics, and compare runs
• Work with MLflow to track experiment metrics, parameters, artifacts and models.

In this module, you will learn how to:

• Describe Model selection and Hyperparameter Tuning
• Select the optimal model by tuning Hyperparameters

In this module, you will learn how to:

• Use Horovod to train a deep learning model
• Use Petastorm to read datasets in Apache Parquet format with Horovod for distributed model training
• Work with Horovod and Petastorm for training a deep learning model

In this module, you will learn how to:

• Use Azure Machine Learning to deploy Serving Models