【总结】深度学习基础知识系列

一、激活函数

链接：资源 | 从ReLU到Sinc，26种神经网络激活函数可视化 https://mp.weixin.qq.com/s?__biz=MzA3MzI4MjgzMw==&mid=2650731769&idx=4&sn=c323c6edc5db4275b47a8d3e115d5447&chksm=871b3087b06cb99120face303174e72097097c94fcfe6abb07cd5f11547a6f968446970cc7c9&mpshare=1&scene=1&srcid=1015BLCvBOcw7DSXb0zed47o&pass_ticket=wTssY1t2auidjPe3G3O%2BR22uU2CNgh8ewmSQO6gQtQuaPny0IquoZIeRsgm%2F78Ns#rd

入门 | 一文概览深度学习中的激活函数 https://mp.weixin.qq.com/s?__biz=MzA3MzI4MjgzMw==&mid=2650732724&idx=4&sn=5230b8bb1811cda38ab97afb417d1613&chksm=871b3ccab06cb5dcdf0bdfadcc7ae85d8ae95588bed0b884a55ba50b76d541771104675fbb3e&mpshare=1&scene=1&srcid=1104IxyJKbkOKsjr812plb46&pass_ticket=wTssY1t2auidjPe3G3O%2BR22uU2CNgh8ewmSQO6gQtQuaPny0IquoZIeRsgm%2F78Ns#rd

二、目标函数优化

链接：入门 | 目标函数的经典优化算法介绍 https://mp.weixin.qq.com/s?__biz=MzA3MzI4MjgzMw==&mid=2650733850&idx=2&sn=00a0e8086ffb441c6cd7d858fc586367&chksm=871b3964b06cb07267cd46802d6cb9c48e21a9eb17b5b1e11912a791396f47657f7f6e8cfcb8&mpshare=1&scene=1&srcid=1127FE5bJOCwgd4BiWG7T1xm&pass_ticket=wTssY1t2auidjPe3G3O%2BR22uU2CNgh8ewmSQO6gQtQuaPny0IquoZIeRsgm%2F78Ns#rd

三、正则化

链接：教程 | 初学者如何学习机器学习中的L1和L2正则化 https://mp.weixin.qq.com/s?__biz=MzA3MzI4MjgzMw==&mid=2650733678&idx=3&sn=5ee8cc5ad692dfe78150b041031c8e13&chksm=871b3810b06cb106f94bc07bffe76909d38638f057a4cd751efdf7ac313af50e87ab324d6bbd&mpshare=1&scene=1&srcid=1125GvUXGid5dShkBecEcyLv&pass_ticket=wTssY1t2auidjPe3G3O%2BR22uU2CNgh8ewmSQO6gQtQuaPny0IquoZIeRsgm%2F78Ns#rd

四、归一化

链接：深度学习中 Batch Normalization https://www.zhihu.com/question/38102762?from=timeline

五、防止过拟合

链接：机器学习中防止过拟合的处理方法 http://blog.csdn.net/heyongluoyao8/article/details/49429629