All Tutorials

Mini Project Development for Azure Data Engineer

Mini Project Development for Azure Data Engineer
Mini Project Development for Azure Data Engineer

Mini Project Development for Azure Data Engineer

Azure Data Factory V2, Azure Data Lake, Azure Databricks, SQL Synapse Analytics, Azure Storage – Blob + ADLS, Azure SQL


  • ETL or Database Knowledge is expected
  • Basic Azure Knowledge is plus
  • Spark knowledge will speed up learning Azure Databricks


Learn All in One Azure Data Engineering services along with hands-on (requirement gathering to implementation) – Codecademy


Recently added sessions:

  • Added code snippets for Databricks <-> SQL Server using JDBC
  • Data Generator code added. Now you can generate your own datasets for this workshop.
  • Copy data from Azure SQL to Azure SQL without ADF (kind of linked server)
  • ADF Code promotion – manual activity
  • Dynamically change DB connection in ADF (Parameterizing linked service)
  • Visible comparison of Blob and Azure Data Lake Gen2 storage using data analytics through Azure Databricks.
  • NY Taxi data files source link added in the resources section
  • Integrate Key Vault with Azure Databricks and extract secrets via Secret Scope
  • Use Blob SDK in Azure Databricks to read/write files on blob-like IO operations
  • Connecting to SQL Server with product in Azure Databricks
  • Datasets used in this course are now available to download. Visit the Azure Data Factory section.


We will execute a small project. It will help you to learn:

1) Design concepts – How to design a big data system. Terminologies of each component/layer.

2) Hands-on – We will be creating required Azure data services and will look at various options available.

3) Tips and Tricks

4) Helps in DP-200 and DP-201 certification preparation.

Technologies you will learn:

Azure Data Factory V2, Databricks (using Standard cluster), Storage Services, SQL Synapse Analytics (DB part)

Course highlights:

1) Resources: Links to an external resource for further reading

2) Datasets: Download and use the dataset used in this course. Do more practice.

3) Architecture and Design: Start learning how to design the data load on a cloud platform.

Who this course is for:

  • Beginners to Azure Data World
  • ETL Developers
  • Database Professionals
  • Last updated 11/2020

Mini Project Development for Azure Data Engineer

Security alarm using GSM Network
Content From:

Download Now