IBM
Generative AI and LLMs: Architecture and Data Preparation
IBM

Generative AI and LLMs: Architecture and Data Preparation

This course is part of Generative AI Engineering with LLMs Specialization

Taught in English

Some content may not be translated

Joseph Santarcangelo
Roodra Pratap Kanwar

Instructors: Joseph Santarcangelo

1,527 already enrolled

Included with Coursera Plus

Course

Gain insight into a topic and learn the fundamentals

4.3

(12 reviews)

Intermediate level

Recommended experience

5 hours (approximately)
Flexible schedule
Learn at your own pace

What you'll learn

  • Differentiate between generative AI architectures and models, such as RNNs, Transformers, VAEs, GANs, and Diffusion Models.

  • Describe how LLMs, such as GPT, BERT, BART, and T5, are used in language processing.

  • Implement tokenization to preprocess raw textual data using NLP libraries such as NLTK, spaCy, BertTokenizer, and XLNetTokenizer.

  • Create an NLP data loader using PyTorch to perform tokenization, numericalization, and padding of text data.

Details to know

Shareable certificate

Add to your LinkedIn profile

Recently updated!

May 2024

Assessments

4 assignments

Course

Gain insight into a topic and learn the fundamentals

4.3

(12 reviews)

Intermediate level

Recommended experience

5 hours (approximately)
Flexible schedule
Learn at your own pace

See how employees at top companies are mastering in-demand skills

Placeholder

Build your subject-matter expertise

This course is part of the Generative AI Engineering with LLMs Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate
Placeholder
Placeholder

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

Placeholder

There are 2 modules in this course

In this module, you will learn about the significance of generative AI models and how they are used across a wide range of fields for generating various types of content. You will learn about the architectures and models commonly used in generative AI and the differences in the training approaches of these models. You will learn how large language models (LLMs) are used to build NLP-based applications. You will build a simple chatbot using the transformers library from Hugging Face.

What's included

4 videos2 readings2 assignments1 app item3 plugins

In this module, you will learn to prepare data for training large language models (LLMs) by implementing tokenization. You will learn about the tokenization methods and the use of tokenizers. You will also learn about the purpose of data loaders and how you can use the DataLoader class in PyTorch. You will implement tokenization using various libraries such as nltk, spaCy, BertTokenizer, and XLNetTokenizer. You will also create a data loader with a collate function that processes batches of text.

What's included

2 videos4 readings2 assignments2 app items2 plugins

Instructors

Joseph Santarcangelo
IBM
33 Courses1,581,804 learners

Offered by

IBM

Recommended if you're interested in Machine Learning

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

New to Machine Learning? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions