All Tutorials

Snowflake cloud database with ELT(Airflow+Python+Talend)

Snowflake cloud database with ELT(Airflow+Python+Talend)

Learn to integrate ETL tools with Snowflake and leverage Airflow for ELT with snowflake.Process 250+ GB data.ELT flow.

What you’ll learn

Snowflake cloud database with ELT(Airflow+Python+Talend)

  • Leveraging snowflake cloud data warehouse using Talend.
  • Talend basics.
  • Airflow basics.
  • Building airflow Dags.
  • Connect snowflake with python.
  • Auditing snowflake commands.
  • Capturing cost and performance metrics.
  • Virtual machine with preconfigured airflow.
  • End to End project to load Nyc traffic data(250 + GB ).

Requirements

  • This course will use virtual box software.
  • A disk space of ~30 Gb is required to run the virtual machine.

Description

In our previous course Snowflake Masterclass [Real time demos+Best practices+Labs] we deep-dived and understood the fundamentals of snowflake, solved a lot of assignments, and understood best practices to load data and unload data.
Also, we closely evaluated most of the snowflake features understanding how they work under the hood. Through these discussions, you realized how to use Snowflake efficiently.

There was one missing piece, How to build and orchestrate ETL workflows on Snowflake. This course is just about that.

In this course, we are going to learn,

  1. Build workflows in Airflow.
  2. We will leverage Talend capabilities to build generic code to ingest data and process data in snowflake.
  3. We will build audit tables and record every command we fire on the snowflake. Record the time consumed for each task and capture snowflake credits.
  4. Once we build the framework we will build a workflow to process and transform 250 + GB volume of NYC traffic data.
  5. At last, we will connect the Snowflake with python and write code to capture stats of data we loaded to the snowflake.
  6. you will also get access to preconfigured Jupyter notebook to run your python code on the Snowflake.

If you have previously not worked with Talend, Airflow and Python don’t worry they are very simple tools I will provide the necessary introduction.

I am sure you will learn a lot from this journey. See you in the course!!

Who this course is for:

  • Developers are interested to know how to build workflows for snowflakes.
  • Last updated 7/2021

Introduction to Python Control Flow Statements Course
Download Now Content From: https://www.udemy.com/course/snowflake-cloud-database-with-airflow-python-talend/

Recent Posts

  • Blog

Earn Money from Areena Course

In today's digital age, opportunities for earning money have expanded significantly. One avenue that has… Read More

8 months ago
  • Blog

Best Earning Apps

Earning apps have become increasingly popular as people look for ways to make money conveniently… Read More

10 months ago
  • Blog

How to Earn Money From Markaz App

In today's fast-paced digital world, opportunities to earn money online have become increasingly popular. One… Read More

10 months ago
  • All Tutorials

Full Web Ethical Hacking Course

Full Web Ethical Hacking Course Learn all about web application penetration testing! What you'll learn… Read More

1 year ago
  • All Tutorials

Build Chatbots Using Javascript

Build Chatbots Using Javascript Build Chatbots Using Javascript From Scratch What you'll learn Build Chatbots… Read More

1 year ago
  • All Tutorials

Basic Learning about Linux Daily use commands

Basic Learning about Linux Daily use commands Basic knowledge to get you started What you'll… Read More

1 year ago