Create a Databricks backed secret scope in Azure Databricks
-
What is Databricks command line interface(CLI)
-
How to install Databricks CLI
-
How to configure Databricks CLI
-
How to generate Databricks token
-
How to connect Databricks workspace using command prompt(CMD) throw CLI
Introduction of Secret Scopes in Azure Databricks
Update Mount Point(dbutils.fs.updateMount()) in Azure Databricks
refreshMounts() commands of File system Utilities in Azure Databricks
Delete or Unmount Mount Points in Azure Databricks
mounts() commands of File system Utilities in Azure Databricks
Mount Azure Blob Storage to DBFS using SAS token in Azure Databricks
Mount Azure Blob Storage to DBFS using Key in Azure Databricks
Create Mount point using dbutils.fs.mount() in Azure Databricks
Parameterize SQL notebook using widgets in Azure Databricks Widgets in SQL in Azure Databricks
Pass values to notebook parameters from another notebook using run command in Azure Databricks
Widgets utility(dbutils.widgets) of Databricks Utilities in Azure Databricks
run() command of notebook utility(dbutils.notebook) in Databricks Utilities in Azure Databricks
exit() command of notebook utility(dbutils.notebook) in Azure Databricks
Data Utilities in Azure Databricks
-
File System utility(dbutils.fs) of Databricks Utilities in Azure Databricks
-
mkdir, put, ls, head, cp, mv, rm
-
Introduction of dbutils module in Azure Databricks
-
List of commands in dbutils module
Databricks File System(DBFS) overview in Azure Databricks
-
Import csv files to DBFS in Azure Databricks
-
Create table from csv files
-
Apply Spark SQL Query on created table
-
Visualize Query result in chart and table
10- Enable Databricks File System(DBFS) in Azure Databrick
9- Introduction of Notebook in Azure Databricks
8- Introduction of cluster in Azure Databricks
7- Working with Workspace Objects in Azure Databricks
6- Workspace Asset and Shortcut in Azure Databricks
5- Workspace in Azure Databricks
4- Create Databricks Workspace Community Edition Account
Create Azure Databricks Workspace using Azure Portal
-
Introduction of Azure Databricks
-
Benefit of Azure Databricks
Agenda:
-
What is Spark
-
Why it’s fast
-
Spark Architecture (Driver, Custer Manager and Worker Node)
-
Worker node details
-
Lifecycle of spark application
-
Spark Attributes
-
Terminologies
-
Supported libraries & Languages