2018年5月1日
Deep RL Bootcamp Lecture 5: Natural Policy Gradients, TRPO, PPO
摘要： https://statweb.stanford.edu/~owen/mc/Ch-var-is.pdf https://zhuanlan.zhihu.com/p/29934206 blue curve is the lower bounded one conjugate gradient to so 阅读全文
posted @ 2018-05-01 17:38 ecoflex 阅读(328) 评论(0) 推荐(0) 编辑
Deep RL Bootcamp Lecture 4B Policy Gradients Revisited
摘要： https://drive.google.com/file/d/0BxXI_RttTZAhTUpqUFdEZ3BXNFE/view game of Pong is a MDP. 终于一睹AK真容了，很有想法，很幽默 http://karpathy.github.io/ 阅读全文
posted @ 2018-05-01 12:52 ecoflex 阅读(174) 评论(0) 推荐(0) 编辑
Comparison among several SGD derivation
摘要： http://www.denizyuret.com/2015/03/alec-radfords-animations-for.html https://zhuanlan.zhihu.com/p/22252270 阅读全文
posted @ 2018-05-01 12:45 ecoflex 阅读(95) 评论(0) 推荐(0) 编辑
2018年4月30日
Deep RL Bootcamp Lecture 4A: Policy Gradients
摘要： in policy gradient, "a" is replaced by "u" usually. use this new form to estimate how good the update is. If all three path show positive reward, shou 阅读全文
posted @ 2018-04-30 20:37 ecoflex 阅读(230) 评论(0) 推荐(0) 编辑
Deep RL Bootcamp Lecture 3: Deep Q-Networks
摘要： https://www.youtube.com/watch?v=fevMOp5TDQs http://www.denizyuret.com/2015/03/alec-radfords-animations-for.html artari is not a MDP, but MDP method wo 阅读全文
posted @ 2018-04-30 16:41 ecoflex 阅读(185) 评论(0) 推荐(0) 编辑
Deep RL Bootcamp Lecture 2: Sampling-based Approximations and Function Fitting
摘要： ... 阅读全文
posted @ 2018-04-30 16:03 ecoflex 阅读(124) 评论(0) 推荐(0) 编辑
Deep RL Bootcamp Lecture 1: Motivation + Overview + Exact Solution Methods
摘要： https://www.youtube.com/watch?v=qaMdN6LS9rA https://drive.google.com/file/d/0BxXI_RttTZAhVXBlMUVkQ1BVVDQ/view match: a4 b1 c2 d3 a The middle one is c 阅读全文
posted @ 2018-04-30 14:52 ecoflex 阅读(204) 评论(0) 推荐(0) 编辑
2018年4月29日
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(22) Lecture 22: Boltzmann Machines
摘要： T in Hinton's paper, was set to 10 initially, and went done gradually to zero. 阅读全文
posted @ 2018-04-29 23:03 ecoflex 阅读(145) 评论(0) 推荐(0) 编辑
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(21) Lecture 21: Hopfield Networks 2
摘要： \ 阅读全文
posted @ 2018-04-29 19:49 ecoflex 阅读(147) 评论(0) 推荐(0) 编辑
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(20) Lecture 20: Hopfield Networks 1
摘要： symmetric version: called Hopfield Net if y <-- minus y, energy won't change! the second last line's first "-" is not the minus sign https://zhuanlan. 阅读全文
posted @ 2018-04-29 16:54 ecoflex 阅读(195) 评论(0) 推荐(0) 编辑
liquid state machine
摘要： https://en.wikipedia.org/wiki/Liquid_state_machine https://www.youtube.com/watch?v=r4wxN2B5PuU https://stackoverflow.com/questions/28326776/liquid-sta 阅读全文
posted @ 2018-04-29 14:16 ecoflex 阅读(848) 评论(0) 推荐(0) 编辑
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(20) Recitation 8: Attention
摘要： http://deeplearning.cs.cmu.edu/recitations/rec8.attention.pdf https://github.com/cmudeeplearning11785/deep-learning-tutorials/blob/master/recitation-8 阅读全文
posted @ 2018-04-29 13:34 ecoflex 阅读(152) 评论(0) 推荐(0) 编辑
2018年4月28日
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(18) Sequence to Sequence models: Attention Models
摘要： https://www.youtube.com/watch?v=oiNFCbD_4Tk <eos> end of section a common trick image to seq problem mistake might happen. look at the fig(1,0) could 阅读全文
posted @ 2018-04-28 22:19 ecoflex 阅读(236) 评论(0) 推荐(0) 编辑
2018年4月27日
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(19) Lecture 16: Variational Autoencoders
摘要： denoise autoencoder AE generates things that look like trained data 太难了，学不下去了！准备zs 学不下去了！ 阅读全文
posted @ 2018-04-27 15:25 ecoflex 阅读(125) 评论(0) 推荐(0) 编辑
2018年4月26日
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(17) Recitation 7: Visualization: What does the network learn
摘要： NN is pretty bad at learning this pattern. green dots are referred to the first layer. blue -> second layer red -> third layer https://github.com/cmud 阅读全文
posted @ 2018-04-26 22:40 ecoflex 阅读(126) 评论(0) 推荐(0) 编辑
2018年4月25日
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(16) Recitation 6: CTC
摘要： https://distill.pub/2017/ctc/ https://en.wikipedia.org/wiki/Beam_search 阅读全文
posted @ 2018-04-25 22:43 ecoflex 阅读(204) 评论(0) 推荐(0) 编辑
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(15) Lecture 15: Representation Learning
摘要： ... 阅读全文
posted @ 2018-04-25 16:29 ecoflex 阅读(150) 评论(0) 推荐(0) 编辑
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(14) Lecture 14: Connectionist Temporal Classification (CTC)
摘要： Xent = cross entropy 阅读全文
posted @ 2018-04-25 14:53 ecoflex 阅读(300) 评论(0) 推荐(0) 编辑
2018年4月24日
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(13) Recitation 5: Recurrent Neural Networks (Introduction)
摘要： https://github.com/cmudeeplearning11785/deep-learning-tutorials/blob/master/recitation-5/recitation5.ipynb http://colah.github.io/posts/2015-08-Unders 阅读全文
posted @ 2018-04-24 21:49 ecoflex 阅读(166) 评论(0) 推荐(0) 编辑
CMU Deep Learning 2018 by Bhiksha Raj 学习记录(12) Lecture 13: Recurrent Neural Networks 3
摘要： Div(Y(1),...,Y(t),Ytarget(1),...,Ytarget(t)) ≠ ∑Div(Y(i),Ytarget(i)) Recurrence is not necessary. http://www.hexahedria.com/2015/08/03/composing-music 阅读全文
posted @ 2018-04-24 17:11 ecoflex 阅读(135) 评论(0) 推荐(0) 编辑