In this workshop Tommy and I show you show how much fun it is to build data pipelines when you have the right tool. Mage.ai offers a solution for Data Engineers that is simple to use and fun! ​ Interactively build, visualize, and run data pipelines that move and prepare data.
Workshop Agenda:
Introduction
Building data pipelines
Bacground: What are data piplines
ETL, ELT & streaming explained
Typical problems building & maintaining data pipelines
Introduction Mage and how it is different from other tools you might know
Hands-on building data pipelines
Building a ETL pipeline loading data from an API
Setting up data integration pipelines
Implementing data validation & quality tests with Great Expectations