Google Cloud
Serverless Data Processing with Dataflow: Operations
Google Cloud

Serverless Data Processing with Dataflow: Operations

This course is part of multiple programs.

1,934 already enrolled

Included with Coursera Plus

Gain insight into a topic and learn the fundamentals.
3.6

(17 reviews)

Advanced level
Designed for those already in the industry
9 hours to complete
3 weeks at 3 hours a week
Flexible schedule
Learn at your own pace
Gain insight into a topic and learn the fundamentals.
3.6

(17 reviews)

Advanced level
Designed for those already in the industry
9 hours to complete
3 weeks at 3 hours a week
Flexible schedule
Learn at your own pace

What you'll learn

  • Perform monitoring, troubleshooting, testing and CI/CD on Dataflow pipelines.

  • Deploy Dataflow pipelines with reliability in mind to maximize stability for your data processing platform

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

7 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Placeholder

Build your subject-matter expertise

This course is available as part of
When you enroll in this course, you'll also be asked to select a specific program.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate
Placeholder
Placeholder

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

Placeholder

There are 9 modules in this course

This module covers the course outline

What's included

2 videos2 readings

In this module, we learn how to use the Jobs List page to filter for jobs that we want to monitor or investigate. We look at how the Job Graph, Job Info, and Job Metrics tabs collectively provide a comprehensive summary of your Dataflow job. Lastly, we learn how we can use Dataflow’s integration with Metrics Explorer to create alerting policies for Dataflow metrics.

What's included

5 videos1 reading1 assignment

In this module, we learn how to use the Log panel at the bottom of both the Job Graph and Job Metrics pages, and learn about the centralized Error Reporting page.

What's included

2 videos1 reading1 assignment

In this module, we learn how to troubleshoot and debug Dataflow pipelines. We will also review the four common modes of failure for Dataflow: failure to build the pipeline, failure to start the pipeline on Dataflow, failure during pipeline execution, and performance issues.

What's included

2 videos1 reading1 assignment1 app item

In this module, we will discuss performance considerations we should be aware of while developing batch and streaming pipelines in Dataflow.

What's included

4 videos1 reading1 assignment

This module will discuss unit testing your Dataflow pipelines. We also introduce frameworks and features available to streamline your CI/CD workflow for Dataflow pipelines.

What's included

5 videos1 reading1 assignment3 app items

In this module we will discuss methods for building systems that are resilient to corrupted data and data center outages.

What's included

5 videos1 reading1 assignment

This module covers Flex Templates, a feature that helps data engineering teams standardize and reuse Dataflow pipeline code. Many operational challenges can be solved with Flex Templates.

What's included

4 videos1 reading1 assignment2 app items

This module reviews the topics covered in the course

What's included

1 video

Instructor

Google Cloud Training
Google Cloud
1,692 Courses2,813,381 learners

Offered by

Google Cloud

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

3.6

17 reviews

  • 5 stars

    47.05%

  • 4 stars

    11.76%

  • 3 stars

    11.76%

  • 2 stars

    11.76%

  • 1 star

    17.64%

Showing 3 of 17

RR
5

Reviewed on Aug 4, 2022

RT
5

Reviewed on Oct 21, 2023

New to Data Analysis? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions