Coursera Project Network
Optimize TensorFlow Models For Deployment with TensorRT
Coursera Project Network

Optimize TensorFlow Models For Deployment with TensorRT

Snehan Kekre

Instructor: Snehan Kekre

5,413 already enrolled

Included with Coursera Plus

Learn, practice, and apply job-ready skills with expert guidance
4.5

(74 reviews)

Intermediate level

Recommended experience

1.5 hours
Learn at your own pace
Hands-on learning
Learn, practice, and apply job-ready skills with expert guidance
4.5

(74 reviews)

Intermediate level

Recommended experience

1.5 hours
Learn at your own pace
Hands-on learning

What you'll learn

  • Optimize Tensorflow models using TensorRT (TF-TRT)

  • Use TF-TRT to optimize several deep learning models at FP32, FP16, and INT8 precision

  • Observe how tuning TF-TRT parameters affects performance and inference throughput

Details to know

Shareable certificate

Add to your LinkedIn profile

Taught in English
No downloads or installation required

Only available on desktop

See how employees at top companies are mastering in-demand skills

Placeholder

Learn, practice, and apply job-ready skills in less than 2 hours

  • Receive training from industry experts
  • Gain hands-on experience solving real-world job tasks
  • Build confidence using the latest tools and technologies
Placeholder

About this Guided Project

Learn step-by-step

In a video that plays in a split-screen with your work area, your instructor will walk you through these steps:

  1. Introduction and Project Overview

  2. Setup your TensorFlow and TensorRT Runtime

  3. Load the Data and Pre-trained InceptionV3 Model

  4. Create batched Input

  5. Load the TensorFlow SavedModel

  6. Get Baseline for Prediction Throughput and Accuracy

  7. Convert a TensorFlow saved model into a TF-TRT Float32 Graph

  8. Benchmark TF-TRT Float32

  9. Convert to TF-TRT Float16 and Benchmark

  10. Converting to TF-TRT INT8

Recommended experience

It is assumed that are competent in Python programming and have prior experience with building deep learning models with TensorFlow and its Keras API

7 project images

Instructor

Instructor ratings
4.5 (7 ratings)
Snehan Kekre
Coursera Project Network
11 Courses110,424 learners

Offered by

How you'll learn

  • Skill-based, hands-on learning

    Practice new skills by completing job-related tasks.

  • Expert guidance

    Follow along with pre-recorded videos from experts using a unique side-by-side interface.

  • No downloads or installation required

    Access the tools and resources you need in a pre-configured cloud workspace.

  • Available only on desktop

    This Guided Project is designed for laptops or desktop computers with a reliable Internet connection, not mobile devices.

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

4.5

74 reviews

  • 5 stars

    68.91%

  • 4 stars

    21.62%

  • 3 stars

    5.40%

  • 2 stars

    2.70%

  • 1 star

    1.35%

Showing 3 of 74

SJ
4

Reviewed on Jun 14, 2023

LS
5

Reviewed on Jun 3, 2021

AA
5

Reviewed on Mar 14, 2022

New to Machine Learning? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions