Practical aspects of deep learning

If your Neural Network model seems to have high variance, what of the following would be promising things to try?

Make the Neural Network deeper

 N

Get more training data

 Y

Get more test data

 N

Add regularization

 Y

Increase the number of units in each hidden layer

 N

 

You are working on an automated check-out kiosk for a supermarket, and are building a classifier for apples, bananas and oranges. Suppose your classifier obtains a training set error of 0.5%, and a dev set error of 7%. Which of the following are promising things to try to improve your classifier? (Check all that apply.)

  

Increase the regularization parameter lambda

Y

Decrease the regularization parameter lambda

 N

Get more training data

 Y

Use a bigger neural network

N