2015-3-31

Long time no blog.

I worked on Interspeech 2015, but failed. The classification accuracy is not as good as excepted. I will change the lower BLSTM layer to CNN to do another test.

I read DRAW yesterday and RAM today. I do not have any insights on these works. I need to learn a lot of prior knowledge.

RAM is a specific case of POMDP and is more of reinforcement learning. DRAW is more of variational inference on networks. But they all learn some attention mechinism.

All these models are important. Memory networks need to label which sentence is useful. Probably there is a reinforement learning way.

Memory, attention, reinforcement learning exists on this.

Fightting.