The demand for technical gen AI skills is exploding. Businesses are hunting hard for AI engineers who can work with large language models (LLMs). This Generative AI Engineering and Fine-Tuning Transformers course builds job-ready skills that will power your AI career forward.
Give your career the gift of Coursera Plus with $160 off, billed annually. Save today.
Generative AI Engineering and Fine-Tuning Transformers
This course is part of multiple programs.
Instructors: Joseph Santarcangelo
Recommended experience
What you'll learn
Sought-after job-ready skills businesses need for working with transformer-based LLMs for generative AI engineering... in just 1 week.
How to perform parameter-efficient fine-tuning (PEFT) using LoRA and QLoRA
How to use pretrained transformers for language tasks and fine-tune them for specific tasks.
How to load models and their inferences and train models with Hugging Face.
Details to know
Add to your LinkedIn profile
September 2024
4 assignments
See how employees at top companies are mastering in-demand skills
Build your subject-matter expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV
Share it on social media and in your performance review
There are 2 modules in this course
In this module, you will be introduced to Fine Tuning. You’ll get an overview of generative models and compare Hugging Face and PyTorch frameworks. You’ll also gain insights into model quantization and learn to use pre-trained transformers and then fine-tune them using Hugging Face and PyTorch.
What's included
5 videos4 readings2 assignments4 app items
In this module, you will gain knowledge about parameter efficient fine-tuning (PEFT) and also learn about adapters such as LoRA (Low-Rank Adaptation) and QLoRA (Quantized Low-Rank Adaptation). In hands-on labs you will train a base model and pre-train LLMs with Hugging Face.
What's included
4 videos4 readings2 assignments2 app items4 plugins
Offered by
Recommended if you're interested in Machine Learning
Why people choose Coursera for their career
New to Machine Learning? Start here.
Open new doors with Coursera Plus
Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose Coursera for Business
Upskill your employees to excel in the digital economy
Frequently asked questions
It takes about 8 hours to complete this course, so you can have the job-ready skills you need to impress an employer within just one week!
This course is intermediate level, so to get the most out of your learning, you must have basic knowledge of Python, PyTorch, and transformer architecture. You should also be familiar with machine learning and neural network concepts.
This course is part of the Generative AI Engineering with LLMs specialization. When you complete the specialization, you will have the skills and confidence to take on job roles such as AI engineer, NLP engineer, machine learning engineer, deep learning engineer, data scientist, or software developer who want to apply seeking to work with LLMs.