Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,175 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

AM

Oct 8, 2019

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

XG

Oct 30, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

Filter by:

6151 - 6175 of 7,253 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Ytsen d B

•

Aug 15, 2017

This course is well taught.

Andrew Ng takes you through the material without error and in a very acceptable pace.

The exercises are very do-able.

They do not challenge hard, but take you by the hand and show you how to implement and improve your neural networks.

The final assignment is a very good tutorial on TensorFlow actually :)

By Emmanuel T

•

Oct 3, 2019

Compared to previous module, this one was more of a cookbook and I expected more mathematics in terms of why each optimization work.

Overall, it was still a very interesting hands on approach, finishing with TensorFlow is a bit more difficult to apprehend as all the previous exercices were done in a very different way (Numpy).

By Varun b

•

Jul 5, 2022

The course content is great as always. It introduces all the concepts in consize manner. The final assignment however fairly rudimentary. Would have been more beneficial to me and perhaps other students, to go through writing the training code rather than having to figure out what tf.transpose or tf.nn.softmax functions are.

By Amminikutty V

•

Nov 17, 2021

First of all thankyou to Prof Andrew and team. This course is really good. I learned a lot of new things. Week 1 & 2 programming assinments are really good but I was not able to understand well the tensorflow introduction assignment in week 3. Rest the knowledge given through this course2 of the specialization is very good.

By Pawel P

•

Dec 9, 2020

Most of the course is great, good overview of different methods and techniques with practical examples. However the TensorFlow programming part is rather confusing, lacking in sufficient explanation of the syntax and overlapping names of python and tensorflow variables which end up producing near impossible to debug errors.

By Girish G

•

Apr 13, 2020

This is an amazing course which dwells into the nuances of fine tuning your neural network model. The content of the course is too good. Programming assignments was a bit off. It was really straightforward. Programming assignments could have been more challenging. This will make sure that the concepts are learned properly.

By Le H L

•

Jun 10, 2018

The content is generally great and helpful, but the grader did not show me why the result is incorrect, and i constantly had to reload jupyter notebook. I think there should be less template for the exercise so that we have more thinking to do, but the expected result should be maintained so that we know what we did wrong.

By Rakesh S

•

Aug 31, 2017

The course explains the reasons and intuition behind tuning hyperparameters and why/how regularization techniques work well when training on large data sets. The only reason I am giving this a 4 star is because the tensorflow introduction seems a little too sparse and could be done better.

Thanks again, team deeplearning.ai

By Juan P A A

•

Jan 27, 2020

The contents are actually good, and it doesn't require a very extensive prior knowledge, so it's even suitable for people with little experience in programming or math. However, despite being a course that has been out for over 2 years, there are still some subtitle issues (in English), and typos on a clarification slide.

By John H

•

Aug 24, 2017

Well explained..sometimes jumps a bit. I felt lost a couple of times. But I got through it and I'd say this is deifnitely one of the top courses out there.

If they included some optional videos on how this could relate to having a career in this area that'd be very helpful (i.e. what level we need to be able to code at).

By Anmol K

•

Jun 16, 2020

This course continues to build on foundations from course 1 of the specialization. Hyperparameter tuning and Regularization methods are quite imperative for optimizing ML models. This course covers these concepts in addition to providing a good foundation for Tensorflow library. Overall, a good course by Prof. Andrew!

By Katsiaryna R

•

Jul 24, 2019

The course was very helpful as now I understand optimization techniques and all the parameters of neural networks. Unfortunately, the course has not answered my question how to tune the whole bunch of hyperparameters from the scratch, what is the correct order and logic of the full ANN tuning, not just one parameter.

By Srinivas R

•

Sep 22, 2017

A very good follow on to the first course with continued excellent organization and hands on assignments that give you practical exposure to working on deep learning problems including a basic introduction to Tensorflow along with practical guidelines on Hyperparameter tuning among other deep learning related topics.

By uday r

•

Mar 11, 2018

Hi,

This course does a really good job in introducing the optimization techniques. Prof. Andrew Ng has structured his lectures well.

Can I kindly suggest that this course can incorporate, for each optimization, 1 scenario that is applicable & 1 that isn't? That will emphasize the scope of the optimization.

Thanks,

Uday

By Shawn W

•

Oct 2, 2017

Still some errors in the assignments, particularly in Week 3. Otherwise, a good course. A lot of good topics for practical use when building real-life neural networks. Some seem fairly cutting-edge. Good, brief, introduction to TensorFlow at the tail-end of Week 3 and in the programming assignment for that week.

By Raghav B

•

Dec 26, 2018

The course content is really great and the theoretical concepts (or their intuition to a larger extent) have been explained pretty well. But there are some errors in the programming exercise on Tensor Flow which makes it confusing since the people who take this course are new to both deep learning and tensor flow.

By Chris A

•

Apr 29, 2018

This is a great course. The only reason for not giving it 5 stars is the notebook platform for grading coding assignments. It is flawed in that attempts to save often error out so a submission often doesn't contain the latest state of the code. This causes sections to be graded incorrectly - very frustrating.

By Dmitrijs T

•

Jan 10, 2020

Course material and Lectures is perfect!

May be would like to have less supervised programming assignments with less hints of how to implement code as it was too easy! May be it would be good to have pretty guided assignments during main part of the course, but something more individual and demanding at the end.

By Carles S F

•

May 28, 2018

I think it is important to understand the basics and that is why it is really cool that they show you how to implement a neural net from sratch. Moreover, the last part on tensorflow shows you how to do it in real life. Nevetheless, a lot of work remains to be done to learn properly how to use tensorflow and NN

By John H

•

May 8, 2020

Andrew Ng is great at explaining the theory and practical aspects of DL concepts. I applaud him for making the lectures so accessible. I also really liked that he provided what is typically done by practitioners. My only feedback I have is that the quiz and programming assignment could have been more rigorous.

By Yunlin Z

•

Sep 7, 2017

the programming assignments are too easy. Though I understand that they're supposed to guide someone who may be a total beginning in ML and DL, I feel there is still too much hand-holding by marking exactly the changes need to be done and the formula either embedded in the comments or in the description above

By Bhavul G

•

Apr 3, 2018

Brilliant. The way this whole course was structured, the correctness of everything, and the amount of thought and preparation that has gone into this is amazing. Thank you.

One suggestion : for those who would want to fiddle with math, there could be optional links to read / understand derivations and stuff.

By Anirudh R

•

Jun 6, 2020

I understood in detail about the various hyper parameters and how to tune them in order to obtain the best results. I learnt about the problem of over fitting and how to solve it. I also got a glimpse of the tensor flow framework and understood how it makes the process of creating neural networks easier.

By Austin G

•

Dec 15, 2018

Great until the last weeks exercise. It definitely needs to be improved. Some of the instructions do not make sense and there are errors in the outputs that make it confusing to follow. However, I did complete it in 1 hour where it said it would take 3. That being said, all videos were amazing as always.

By JATIN S

•

Jul 27, 2020

The content for the first two weeks can be thoroughly practised using the programming assignments but for the 3rd week there is a huge gap in the practise material provided.The majority of the content taught during this week is not covered in the programming assignment.Hope this gets seen and rectified.