Mini Project Development for Azure Data Engineer

Learn All in One Azure Data Engineering services along with hands-on (requirement gathering to implementation) – Codecademy

——————————————————————————————————————

Recently added sessions:

• Added code snippets for Databricks <-> SQL Server using JDBC
• Data Generator code added. Now you can generate your own datasets for this workshop.
• Copy data from Azure SQL to Azure SQL without ADF (kind of linked server)
• ADF Code promotion – manual activity
• Dynamically change DB connection in ADF (Parameterizing linked service)
• Visible comparison of Blob and Azure Data Lake Gen2 storage using data analytics through Azure Databricks.
• NY Taxi data files source link added in the resources section
• Integrate Key Vault with Azure Databricks and extract secrets via Secret Scope
• Use Blob SDK in Azure Databricks to read/write files on blob-like IO operations
• Connecting to SQL Server with product in Azure Databricks
• Datasets used in this course are now available to download. Visit the Azure Data Factory section.

——————————————————————————————————————

We will execute a small project. It will help you to learn:

1) Design concepts – How to design a big data system. Terminologies of each component/layer.

2) Hands-on – We will be creating required Azure data services and will look at various options available.

3) Tips and Tricks

4) Helps in DP-200 and DP-201 certification preparation.

Technologies you will learn:

Azure Data Factory V2, Databricks (using Standard cluster), Storage Services, SQL Synapse Analytics (DB part)

Course highlights:

1) Resources: Links to an external resource for further reading

2) Datasets: Download and use the dataset used in this course. Do more practice.

3) Architecture and Design: Start learning how to design the data load on a cloud platform.