2017年3月31日
Layer Normalization
摘要： Ba, Jimmy Lei, Jamie Ryan Kiros, and Geoffrey E. Hinton. "Layer normalization." arXiv preprint arXiv:1607.06450 (2016). Batch Normalization是对每个神经元做归一化 阅读全文
posted @ 2017-03-31 20:14 Shiyu_Huang 阅读(7271) 评论(0) 推荐(0) 编辑
Using Fast Weights to Attend to the Recent Past
摘要： Ba, Jimmy, et al. "Using Fast Weights to Attend to the Recent Past." Advances In Neural Information Processing Systems. 2016. 感觉就是引入了memory的机制，多了一个矩阵A 阅读全文
posted @ 2017-03-31 16:13 Shiyu_Huang 阅读(742) 评论(0) 推荐(0) 编辑
A Deep Compositional Framework for Human-like Language Acquisition in Virtual Environment
摘要： 论文地址：https://128.84.21.199/abs/1703.09831 这篇论文来自于百度的机器学习研究院，作者为：徐伟、余昊男、张海超 这篇论文用了多种技术的组合: reinforcement learning, word embedding, attention, question 阅读全文
posted @ 2017-03-31 14:38 Shiyu_Huang 阅读(360) 评论(0) 推荐(0) 编辑