摘要: 1. requires_grad = False Set all parameters in the current model frozen: Filter some specific layers by name to be frozen: 2. Filter out unfrozen para 阅读全文
posted @ 2019-03-29 22:04 leizhao 阅读(261) 评论(0) 推荐(0) 编辑
摘要: Sigmoid Sigmoids saturate and kill gradients. Sigmoid outputs are not zero-centered. Exponential function is a little computational expensive. Tanh Ki 阅读全文
posted @ 2019-03-29 19:35 leizhao 阅读(144) 评论(0) 推荐(0) 编辑
摘要: Linear Classifier and Hing Loss (or Multiclass SVM Loss) Linear Mapping (Score function) Linear Classifier Hinge Loss Regularization Softmax Classifie 阅读全文
posted @ 2019-03-29 16:26 leizhao 阅读(236) 评论(0) 推荐(0) 编辑