Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,175 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

AM

Oct 8, 2019

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

XG

Oct 30, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

Filter by:

6251 - 6275 of 7,253 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Prashant M

•

Oct 25, 2017

Some lectures seem to have inconsistent/unexplained differences in the math written. For example, I am a bit confused as to whether normalization is done as (x - mean)/variance or (x - mean)/std.dev. Otherwise, excellent content as always!

By K S

•

Jun 5, 2021

In some other courses there was a pdf document at the end of the courses which very good if you want revisit them but in these courses its not available. Please make them available here which will be a very time saving for quick revisions

By Tianyi L

•

Nov 19, 2017

In overall, the course content is helpful and inspiring as normal, and can be used to real life straight away. However there are several typos/mistakes in the assignment, especially in assignment 3 which I had bad time to experience with.

By Rahul K

•

Jul 24, 2018

The best course in deep learning: Hyperparameter tuning, regularization and Optimization. The course is best among all the available courses over internet but it lacks availability of study materials (or reference to reading materials).

By Jairo L D A

•

Apr 24, 2018

Very good content. Professor Ng covers a lot of material in a gentle and steady way. A few errors in the assignment and less clarity on some texts and quiz make me give 4 stars, but overall it's a very useful, important course, I think.

By Jason A B

•

Sep 30, 2017

Great course for in-dept understanding of parameter tuning and optimization, +tensorflow. I would recommend increasing the complexity of the programming assignments. At this point we should be controlling more of the basic python setup.

By Giordano S

•

Sep 28, 2017

Maybe not as exciting as the first course of this series (Neural Networks and Deep Learning) as this one delves more in the "technicalities" of NN. The presentation of the topics, however, is always very clear and easily understandable.

By srinivasan v

•

Jan 8, 2018

Struggled a bit to grasp the batch nomalization, Initially Regularization was also hard to grasp the first time, subsequent viewing made it clear though but batch norm still is a bit hazy. I am happy though we are in to Tensorflow now.

By P.C. C

•

Feb 27, 2021

The material was excellent for this class and so were the lectures. I think more programming assignments could have been optimal though. There are so many concepts, and I think there are several pieces we didn't implement in practice.

By Tristan C

•

Apr 4, 2020

There were still a few times where I felt some clever editing could have hidden math errors but I felt the second part was already more polished and accessible than the first. I hope the rest of the series continues in this direction.

By daniele r

•

Jul 15, 2019

One of the best and most technical course in this Specialization: I enjoyed learning a lot on optimization algorithms. Really good practical hints on tuning and on bias variance analysis, that are very difficult to find in textbooks

By Anwesh J

•

Jul 18, 2020

Indeed this is an awesome course for any beginners in deep learning.One suggestion could be is why you have selected Tensorflow framework.Will it be possible to get same assignment in Pytorch framework which out institiute follows.

By Charles S

•

Nov 24, 2017

This course was excellent, however the Tensor flow at the end feels a little bit like the ML field is quickly being overtaken by the frameworks, and the Tensor flow section is a little bit tacked onto this course, maybe in a hurry.

By Ashok T

•

Dec 31, 2019

Interesting practical suggestions regarding hyperparameter tuning and batch normalization, it could be more mathematical with more programming assignments with the effects of tuning. The TF framework was kind of surprise in Week 3

By il K

•

Mar 9, 2018

As always, great course from Andrew: easy to be understood, useful trainings and exercices. The lecture are explained slowly and repeating the important concept, always a good think.

Thanks! I will proceed with my Specialization :)

By Federico A

•

May 29, 2020

The content of the course is excelent and the practice exercises very interesting and helpful. I feel there is missing a written resume of the concepts after each video, or a hand-in of the powerpoint presentations would be nice.

By Shahar M

•

Apr 10, 2020

Pros: The course covers the basics for hyperparameters, tunning, regularization and optimization. The basics that it covers are well presented and explained.

Cons: A much more detailed and intense work with TensorFlow is needed.

By Paramjit S

•

Apr 13, 2019

The course is really good and the explanation by Dr Ng is exhaustive. But I think the assignments were meant for beginner level. You will not be implementing any function instead you be writing the underlying formulas. That' it.

By Hamza M K

•

Jun 26, 2018

This is another great introduction to Depp learning frameworks apart from all the neural network performance upgrading techniques taught. This is an excellent course for building a strong foundation of deep learning fundamentals

By Zahid S

•

Mar 16, 2019

This course was mostly well-designed especially for the first topics, but in my view, the Tensorflow part needs to be extended. It provided a brief understanding of the topics, but I do believe deeper examples might be helpful.

By Joris

•

Feb 10, 2018

better than the first course since it involved breaking into new stuff w.r.t the Stanford Machine Learning course.. However, altogether not yet challenging enough to give 5 stars

Really interested to go deeper into this matter..

By Dr. H H W

•

Aug 8, 2019

Interesting material but a bit complex to follow all the equation derivation. Need to repeatedly watching the video to understand the content. After learning this the hyper parameter setting in the ML setup is clearer to me.

By Jean-Simon B

•

May 8, 2018

I would like to have harder programming assignment, perhaps optional. Because instead of understanding the problem I just had to read the question again, answer were always in questions, then copy paste and change "x" by "X"

By Tom T

•

Dec 4, 2019

Overall, it's pretty good. I did have a problem understanding some of the facts being communicated about gamma and beta in batch norm. Also, I think there is a problem with the last notebook. My cost did not go down as fast.

By Teddy G

•

Nov 17, 2019

I think the last subject, the "gradient checking" looks a bit not connected to the begining of the week 2 course, it may be only me, so I will go over it again and try to understand its relevancy to the rest of week 2.

Teddy