This course equips machine learning practitioners with the essential tools, techniques, and best practices for evaluating both generative and predictive AI models. Model evaluation is a critical discipline for ensuring that ML systems deliver reliable, accurate, and high-performing results in production.
What you'll learn
Understand the nuances of model evaluation in both predictive and generative AI, recognizing its crucial role within the MLOps lifecycle.
Identify and apply appropriate evaluation metrics for different generative AI tasks.
Efficiently evaluate generative AI with Vertex AI's diverse evaluation services, including both computation-based and model-based methods.
Implement best practices for LLM evaluation, to ensure robust and reliable model deployment in production environments.
Details to know
Add to your LinkedIn profile
October 2024
2 assignments
See how employees at top companies are mastering in-demand skills
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV
Share it on social media and in your performance review
There are 4 modules in this course
This module covers the course objectives and provides an overview of the course structure.
What's included
1 video
This module introduces model evaluation challenges and solution offerings by Vertex AI.
What's included
3 videos1 reading1 assignment
This module describes challenges of evaluating the Generative AI tasks and best practices to overcome these challenges. The module also covers the different types of model evaluation services available in Vertex AI and then introduces Vertex AI Automatic Metrics, Automatic Side by Side and Safety Bias evaluation services.
What's included
7 videos1 reading1 assignment
This module provides a summary of the entire course by covering the most important concepts, tools, technologies, and products.
What's included
1 video
Instructor
Offered by
Why people choose Coursera for their career
New to Software Development? Start here.
Open new doors with Coursera Plus
Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose Coursera for Business
Upskill your employees to excel in the digital economy
Frequently asked questions
Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.
If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.
Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.