Data Integration with Microsoft Azure Data Factory

Give your career the gift of Coursera Plus with $160 off, billed annually. Save today.

Data Integration with Microsoft Azure Data Factory

This course is part of Microsoft Azure Data Engineering Associate (DP-203) Professional Certificate

Instructor: Microsoft

17,734 already enrolled

Included with Coursera Plus

Learn more

8 modules

Gain insight into a topic and learn the fundamentals.

3.9

(166 reviews)

Intermediate level

Recommended experience

15 hours to complete

3 weeks at 5 hours a week

Flexible schedule

Learn at your own pace

8 modules

Gain insight into a topic and learn the fundamentals.

3.9

(166 reviews)

Intermediate level

Recommended experience

15 hours to complete

3 weeks at 5 hours a week

Flexible schedule

Learn at your own pace

What you'll learn

How to create and manage data pipelines in the cloud
How to integrate data at scale with Azure Synapse Pipeline and Azure Data Factory

Skills you'll gain

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

25 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

Build your Data Analysis expertise

This course is part of the Microsoft Azure Data Engineering Associate (DP-203) Professional Certificate

When you enroll in this course, you'll also be enrolled in this Professional Certificate.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate from Microsoft

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

There are 8 modules in this course

In this course, you will learn how to create and manage data pipelines in the cloud using Azure Data Factory.

This course is part of a Specialization intended for Data engineers and developers who want to demonstrate their expertise in designing and implementing data solutions that use Microsoft Azure data services. It is ideal for anyone interested in preparing for the DP-203: Data Engineering on Microsoft Azure exam (beta). This is the third course in a program of 10 courses to help prepare you to take the exam so that you can have expertise in designing and implementing data solutions that use Microsoft Azure data services. The Data Engineering on Microsoft Azure exam is an opportunity to prove knowledge expertise in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions that use Microsoft Azure data services. Each course teaches you the concepts and skills that are measured by the exam. By the end of this Specialization, you will be ready to take and sign-up for the Exam DP-203: Data Engineering on Microsoft Azure (beta).

Describe the core components of Azure Data Factory that enable you to create large scale data ingestion solutions in the cloud

What's included

9 videos7 readings3 assignments1 discussion prompt1 plugin

9 videosTotal 26 minutes

Introduction to the course2 minutesPreview module
Understand Azure Data Factory3 minutes
Data integration patterns5 minutes
Explain the data factory process1 minute
Understand Azure Data Factory components3 minutes
Azure Data factory Security1 minute
Lesson introduction1 minute
Manage integration runtimes5 minutes
Lesson summary1 minute

7 readingsTotal 50 minutes

Course syllabus5 minutes
How to be successful in this course5 minutes
Example - Set-up Azure Data Factory 5 minutes
Example - Create linked services5 minutes
Example - Create datasets 5 minutes
Example - Create data factory activities and pipelines10 minutes
Additional resources15 minutes

3 assignmentsTotal 66 minutes

Test prep30 minutes
Knowledge check18 minutes
Knowledge check18 minutes

1 discussion promptTotal 10 minutes

Meet and greet10 minutes

1 pluginTotal 2 minutes

Azure Data Factory components2 minutes

Describe the various methods that can be used to ingest data between various data stores using Azure Data Factory

What's included

5 videos4 readings2 assignments

5 videosTotal 13 minutes

Lesson introduction1 minutePreview module
List the data factory ingestion methods2 minutes
Describe data factory connectors1 minute
Understand data ingestion security considerations7 minutes
Lesson summary1 minute

4 readingsTotal 25 minutes

Example -Use the data factory copy activity - Example5 minutes
Example - Manage the self-hosted integration runtime5 minutes
Set up the Azure integration runtime 5 minutes
Additional resources10 minutes

2 assignmentsTotal 45 minutes

Test prep30 minutes
Knowledge check15 minutes

Perform common data transformation and cleansing activities within Azure Data Factory without using code Implement Slowly Changing Dimension using Azure Data Factory or Azure Synapse Pipelines

What's included

7 videos7 readings5 assignments1 plugin

7 videosTotal 16 minutes

Lesson introduction1 minutePreview module
Explain Azure Data Factory transformation methods2 minutes
Debug mapping data flow1 minute
Lesson summary1 minute
Describe slowly changing dimensions3 minutes
Choose between slowly changing dimension types4 minutes
Lesson summary1 minute

7 readingsTotal 84 minutes

Azure Data Factory transformation types5 minutes
Exercise: Author an Azure Data Factory mapping data flow20 minutes
Use Azure Data Factory wrangling data8 minutes
Example - Use compute transformations within Azure Data Factory15 minutes
Integrate SQL server integration services packages within Azure Data Factory15 minutes
Additional resources3 minutes
Exercise - Design and implement a Type 1 slowly changing dimension with mapping data flows18 minutes

5 assignmentsTotal 66 minutes

Test prep27 minutes
Exercise quiz3 minutes
Knowledge check18 minutes
Exercise quiz3 minutes
Knowledge check15 minutes

1 pluginTotal 2 minutes

Azure Data Factory transformation methods2 minutes

Use Azure Data Factory to orchestrate large scale data movement by using other Azure Data Platform and Machine Learning technologies

What's included

6 videos1 reading3 assignments

6 videosTotal 25 minutes

Understand data factory control flow5 minutesPreview module
Work with data factory pipelines2 minutes
Debug data factory pipelines7 minutes
Add parameters to data factory components6 minutes
Execute data factory packages1 minute
Lesson summary0 minutes

1 readingTotal 25 minutes

Exercise - Integrate a Notebook within Azure Synapse Pipelines25 minutes

3 assignmentsTotal 45 minutes

Test prep24 minutes
Excercise quiz3 minutes
Knowledge check18 minutes

Integrate SQL Server Integration Services packages into an Azure Data Factory solution

What's included

3 videos3 readings2 assignments

3 videosTotal 9 minutes

Describe SQL Server integration services3 minutesPreview module
Understand the Azure SSIS Integration Runtime3 minutes
Lesson summary1 minute

3 readingsTotal 30 minutes

Example - Setup an Azure-SSIS Integration Runtime 10 minutes
Example - Run SSIS packages in Azure Data Factory10 minutes
Example - Migrate SSIS packages to Azure Data Factory 10 minutes

2 assignmentsTotal 42 minutes

Test prep24 minutes
knowledge check18 minutes

Publish your Azure Data Factory work between different environments

What's included

3 videos6 readings2 assignments

3 videosTotal 6 minutes

Lesson introduction1 minutePreview module
Manage source control of Azure Data Factory solutions3 minutes
Lesson summary1 minute

6 readingsTotal 58 minutes

Understand the language support in Azure Data Factory5 minutes
Connect to a Git repository10 minutes
Continuous integration and deployment25 minutes
Monitor Azure Data Factory pipelines10 minutes
Set up alerts for Azure Data Factory5 minutes
Rerun Azure Data Factory pipelines3 minutes

2 assignmentsTotal 48 minutes

Test prep30 minutes
Knowledge check18 minutes

Ingest data from Azure Data Share into Azure Data Factory pipelines to build automated ingestion pipelines

What's included

6 videos6 readings7 assignments

6 videosTotal 12 minutes

Module introduction3 minutesPreview module
Ingest data into Azure Data Lake Gen 2 using Azure Data Factory2 minutes
Join and transform shared and owned data with Mapping Flow in Azure Data Factory2 minutes
Sink dataset into Azure Synapse Analytics using Azure Data Factory1 minute
Publish a pipeline run in Azure Data Factory1 minute
Module summary1 minute

6 readingsTotal 70 minutes

Exercise: Share and receive data using Azure Data Share and transform data using Azure Data Factory15 minutes
Exercise: Ingest data into Azure Data Lake Storage Gen 2 with Azure Data Factory15 minutes
Exercise: Join and transform shared and current dataset with Mapping Flow in Azure Data Factory15 minutes
Exercise: Sink dataset into Azure Synapse Analytics with Azure Data Factory5 minutes
Exercise: Publish a pipeline run in Azure Data Factory5 minutes
Additional resources15 minutes

7 assignmentsTotal 66 minutes

Test prep18 minutes
Exercise quiz3 minutes
Exercise quiz3 minutes
Knowledge check18 minutes
Exercise quiz3 minutes
Exercise quiz3 minutes
Knowledge check18 minutes

Practice Exam on Data integration at scale with Azure Data Factory or Azure Synapse Pipeline

What's included

2 videos2 readings1 assignment1 discussion prompt

Instructor

Instructor ratings

4.5 (42 ratings)

Microsoft

196 Courses1,047,818 learners

Offered by

Microsoft

Recommended if you're interested in Data Analysis

Whizlabs
Storage in Azure
Course
Coursera Project Network
Integrando DevOps con Azure App Service
Guided Project
University of Colorado System
Data Warehouse Concepts, Design, and Data Integration
Course
Whizlabs
Exam Prep AI-102: Microsoft Azure AI Engineer Associate
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

Showing 3 of 166

3.9

166 reviews

5 stars
46.38%
4 stars
19.27%
3 stars
15.66%
2 stars
10.84%
1 star
7.83%

Reviewed on Dec 20, 2023

Reviewed on May 1, 2023

Reviewed on May 16, 2024

View more reviews

New to Data Analysis? Start here.

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Learn more

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Explore degrees

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Learn more

Frequently asked questions

Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:

The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Certificate, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.

If you subscribed, you get a 7-day free trial during which you can cancel at no penalty. After that, we don’t give refunds, but you can cancel your subscription at any time. See our full refund policy.

Data Integration with Microsoft Azure Data Factory

What you'll learn

Skills you'll gain

Details to know

See how employees at top companies are mastering in-demand skills

Build your Data Analysis expertise

Earn a career certificate

There are 8 modules in this course

Integrate data with Azure Data Factory or Azure Synapse Pipeline

What's included

Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline

What's included

Perform code-free transformation at scale with Azure Data Factory or Azure Synapse Pipeline

What's included

Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline

What's included

Execute existing SSIS packages in Azure Data Factory or Azure Synapse Pipeline

What's included

Operationalize your Azure Data Factory or Azure Synapse Pipeline

What's included

Receive data with Azure Data Share and transforming with Azure Data Factory

What's included

Course Practice Exam

What's included

Instructor

Offered by

Recommended if you're interested in Data Analysis

Storage in Azure

Integrando DevOps con Azure App Service

Data Warehouse Concepts, Design, and Data Integration

Exam Prep AI-102: Microsoft Azure AI Engineer Associate

Why people choose Coursera for their career

Learner reviews

New to Data Analysis? Start here.

Open new doors with Coursera Plus

Advance your career with an online degree

Join over 3,400 global companies that choose Coursera for Business

Frequently asked questions

When will I have access to the lectures and assignments?

What will I get if I subscribe to this Certificate?

What is the refund policy?

More questions