摘要:
记录一些常见的概念。 (香侬)熵 Information entropy is the average rate at which information is produced by a stochastic source of data. $$H[x]= \sum_{x} p(x) \log _ 阅读全文
摘要:
整理一下要读的已读的书籍论文,加粗为还没有读的 神经网络通用理论 优化方法,正则化,训练技巧等 Understanding the difficulty of training deep feedforward neural networks (AISTATS 2010) Dropout: A Si 阅读全文