IBM
Generative AI and LLMs: Architecture and Data Preparation

Give your career the gift of Coursera Plus with $160 off, billed annually. Save today.

IBM

Generative AI and LLMs: Architecture and Data Preparation

This course is part of multiple programs.

Joseph Santarcangelo
Roodra Pratap Kanwar

Instructors: Joseph Santarcangelo

4,674 already enrolled

Included withCoursera Plus

Gain insight into a topic and learn the fundamentals.
4.7

(66 reviews)

Intermediate level

Recommended experience

5 hours to complete
3 weeks at 1 hour a week
Flexible schedule
Learn at your own pace
Gain insight into a topic and learn the fundamentals.
4.7

(66 reviews)

Intermediate level

Recommended experience

5 hours to complete
3 weeks at 1 hour a week
Flexible schedule
Learn at your own pace

What you'll learn

  • Differentiate between generative AI architectures and models, such as RNNs, Transformers, VAEs, GANs, and Diffusion Models.

  • Describe how LLMs, such as GPT, BERT, BART, and T5, are used in language processing.

  • Implement tokenization to preprocess raw textual data using NLP libraries such as NLTK, spaCy, BertTokenizer, and XLNetTokenizer.

  • Create an NLP data loader using PyTorch to perform tokenization, numericalization, and padding of text data.

Details to know

Earn a career certificate

Add to your LinkedIn profile

Assessments

4 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Placeholder

Build your subject-matter expertise

This course is available as part of
When you enroll in this course, you'll also be asked to select a specific program.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate
Placeholder
Placeholder

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

Placeholder

There are 2 modules in this course

In this module, you will learn about the significance of generative AI models and how they are used across a wide range of fields for generating various types of content. You will learn about the architectures and models commonly used in generative AI and the differences in the training approaches of these models. You will learn how large language models (LLMs) are used to build NLP-based applications. You will build a simple chatbot using the transformers library from Hugging Face.

What's included

5 videos2 readings2 assignments1 app item3 plugins

In this module, you will learn to prepare data for training large language models (LLMs) by implementing tokenization. You will learn about the tokenization methods and the use of tokenizers. You will also learn about the purpose of data loaders and how you can use the DataLoader class in PyTorch. You will implement tokenization using various libraries such as nltk, spaCy, BertTokenizer, and XLNetTokenizer. You will also create a data loader with a collate function that processes batches of text.

What's included

2 videos4 readings2 assignments2 app items2 plugins

Instructors

Instructor ratings
3.9 (14 ratings)
Joseph Santarcangelo
IBM
33 Courses1,665,973 learners

Offered by

IBM

Recommended if you're interested in Machine Learning

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

Showing 3 of 66

4.7

66 reviews

  • 5 stars

    77.46%

  • 4 stars

    15.49%

  • 3 stars

    4.22%

  • 2 stars

    2.81%

  • 1 star

    0%

VK
5

Reviewed on Oct 17, 2024

AB
4

Reviewed on Oct 20, 2024

New to Machine Learning? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions