Kafka Fundamentals

Give your career the gift of Coursera Plus with $160 off, billed annually. Save today.

Kafka Fundamentals

This course is part of Apache Kafka Specialization

Instructor: LearnKartS

1,555 already enrolled

Included with Coursera Plus

Learn more

3 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Recommended experience

4 hours to complete

3 weeks at 1 hour a week

Flexible schedule

Learn at your own pace

3 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Recommended experience

4 hours to complete

3 weeks at 1 hour a week

Flexible schedule

Learn at your own pace

What you'll learn

Understand data evolution, the significance of big data, analytics applications, and messaging systems.
Learn Kafka's key features, components, architecture, and industry use cases.
How to Set up Kafka environments and install Zookeeper and Kafka
Learn Kafka producer and consumer basics, configurations, and operations. Work with serializers and deserializers, and manage offsets.

Skills you'll gain

Details to know

Shareable certificate

Add to your LinkedIn profile

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

Build your subject-matter expertise

This course is part of the Apache Kafka Specialization

When you enroll in this course, you'll also be enrolled in this Specialization.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

There are 3 modules in this course

Welcome to the Kafka Fundamentals course!

The course is designed to provide you with a comprehensive understanding of Apache Kafka, a distributed streaming platform used for building real-time data pipelines and streaming applications. Whether you are new to Kafka or seeking to solidify your foundational knowledge, this course will equip you with the skills needed to effectively utilize Kafka in various real-world scenarios. This course requires a basic understanding of distributed systems and familiarity with Java or Python programming languages. This course is ideal for software developers, data engineers, system administrators, and IT professionals who are looking to leverage Kafka for data streaming and real-time analytics. The course provides a comprehensive introduction to key big data concepts and messaging systems, laying a solid foundation for understanding data processing dynamics. By the end of this course, you will be able to: - Understand data evolution, big data significance, analytics applications, and messaging systems. - Learn Kafka's key features, components, architecture, and industry use cases. - Set up Kafka environments and install Zookeeper and Kafka. - Master Kafka producer and consumer basics, configurations, and operations. - Work with serializers and deserializers and manage offsets and rebalancing. This course contains engaging videos, hands-on demonstrations, readings, and assessments to ensure a comprehensive understanding of Apache Kafka.

This module provides an overview of Big Data, messaging systems, and Apache Kafka, including installation and setup demonstrations. By the end of this, learners will be able to install and configure the Kafka environment.

What's included

16 videos2 readings4 assignments1 discussion prompt

16 videosTotal 49 minutes

Course Introduction2 minutesPreview module
Data Evolution Over Time4 minutes
Big Data Overview2 minutes
Big Data Analytics2 minutes
Messaging System5 minutes
Introduction and Features of Kafka4 minutes
Kafka Use Cases4 minutes
Kafka Terminologies1 minute
Kafka Components6 minutes
Kafka Architecture0 minutes
Kafka Clusters1 minute
Kafka Industry Use Cases2 minutes
DEMO: Install Zookeeper3 minutes
DEMO: Install Kafka1 minute
DEMO: Set up a Single Node Single Broker Cluster2 minutes
DEMO: Set up a Multi-Node Single Broker Cluster2 minutes

2 readingsTotal 6 minutes

Specialization Introduction4 minutes
Introduction and Syllabus2 minutes

4 assignmentsTotal 26 minutes

Big Data and Apache Kafka12 minutes
Big Data Evolution4 minutes
Kafka Basics6 minutes
Zookeeper and Kafka Cluster Setup4 minutes

1 discussion promptTotal 5 minutes

Getting Started with Big Data and Apache Kafka5 minutes

This module provides an overview of Kafka Producer, covering its architecture and configuration. By completing this module, learners will be able to create and configure Kafka Producers, handle message serialization, and manage partitioning.

What's included

12 videos4 assignments1 discussion prompt

12 videosTotal 45 minutes

Overview of Producer and Architecture4 minutesPreview module
Kafka Producer Configuration2 minutes
Kafka Producer Optional Configuration2 minutes
Kafka Producer Configuration Objects6 minutes
DEMO: Create a Kafka Producer2 minutes
Sending Messages4 minutes
Serializers and Custom Serializers3 minutes
DEMO: Creating a Custom Serializer3 minutes
Serializers Challenges and Serializing Using Apache Avro4 minutes
DEMO: Serializing Using Apache Avro2 minutes
Partitions4 minutes
DEMO: Set up Custom Partition4 minutes

4 assignmentsTotal 32 minutes

Kafka Producer12 minutes
Configuring Kafka Producers6 minutes
Working with Serializer6 minutes
Kafka Partitions8 minutes

1 discussion promptTotal 5 minutes

Working with Kafka Producer5 minutes

This module introduces Kafka Consumer fundamentals, including consumer groups, offset management, and deserialization techniques. By completing this module, learners will gain the ability to create Kafka Consumers, effectively manage offsets, and implement custom deserializers for efficient data processing.

What's included

17 videos1 reading4 assignments1 discussion prompt

17 videosTotal 50 minutes

Overview of Kafka Consumer2 minutesPreview module
Consumer Groups4 minutes
Partition Rebalance and Creating a Consumer4 minutes
Poll Loop and Its Functioning2 minutes
Configuring Kafka Consumer: fetch.min.bytes, fetch.max.wait.ms, max.partition.fetch.bytes, session.timeout.ms4 minutes
Kafka Consumer Configuration: auto.offset.reset, enable.auto.commit, partition.assignment.strategy, client.id, max.poll.records, receive.buffer.bytes, send.buffer.bytes5 minutes
DEMO: Create Kafka Consumer2 minutes
Commit and Offset3 minutes
Ways of Committing Offset - Automatic Offset2 minutes
Ways of Committing Offset - Commit Current Offset1 minute
Ways of Committing Offset - Asynchronous Commit2 minutes
Ways of Committing Offset - Synchronous and Asynchronous Offset1 minute
Ways of Committing Offset - Commit Specified Offset1 minute
Rebalance Listeners1 minute
Consuming Records with Specific Offset4 minutes
Introduction to Deserializers3 minutes
DEMO: Create and Use a Custom Deserializer2 minutes

1 readingTotal 2 minutes

Course Synopsis2 minutes

4 assignmentsTotal 30 minutes

Kafka Consumer12 minutes
Optimizing Kafka Consumers6 minutes
Kafka Offset Handling8 minutes
Kafka Deserialization4 minutes

1 discussion promptTotal 5 minutes

Working with Kafka Consumer5 minutes

Instructor

LearnKartS

63 Courses28,254 learners

Offered by

LearnKartS

Recommended if you're interested in Software Development

Packt
The Ultimate Hands-On Hadoop
Course
Coursera Instructor Network
Engineering Data Ecosystems: Pipelines, ETL, Spark
Course
Packt
AWS Data Processing and Analysis
Course
IBM
Introduction to Big Data with Spark and Hadoop
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

New to Software Development? Start here.

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Learn more

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Explore degrees

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Learn more

Frequently asked questions

Apache Kafka is an open-source stream-processing software platform developed by LinkedIn and donated to the Apache Software Foundation, written in Scala and Java. Kafka is designed to handle real-time data feeds with high throughput and low latency

The course primarily uses Java for coding examples and exercises, as Kafka itself is written in Java. Some exercises may also involve Scala and command-line scripts.

Yes, a course completion certificate is allocated upon completing all graded assignments and quizzes present in the Kafka Fundamentals course.

Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:

The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.

Kafka Fundamentals

What you'll learn

Skills you'll gain

Details to know

See how employees at top companies are mastering in-demand skills

Build your subject-matter expertise

Earn a career certificate

There are 3 modules in this course

Getting Started with Big Data and Apache Kafka

What's included

Kafka Producer

What's included

Kafka Consumer

What's included

Instructor

Offered by

Recommended if you're interested in Software Development

The Ultimate Hands-On Hadoop

Engineering Data Ecosystems: Pipelines, ETL, Spark

AWS Data Processing and Analysis

Introduction to Big Data with Spark and Hadoop

Why people choose Coursera for their career

New to Software Development? Start here.

Open new doors with Coursera Plus

Advance your career with an online degree

Join over 3,400 global companies that choose Coursera for Business

Frequently asked questions

What is Apache Kafka?

What programming languages are used in the course?

Is a certificate provided upon completion of the course?

More questions