(转) AI突破性论文及代码实现汇总

本文转自：https://zhuanlan.zhihu.com/p/25191377

AI突破性论文及代码实现汇总

What Can AI Do For You?

“The business plans of the next 10,000 startups are easy to forecast: Take X and add AI.” — Kevin Kelly

"A hundred years ago electricity transformed countless industries; 20 years ago the internet did, too. Artificial intelligence is about to do the same. To take advantage, companies need to understand what AI can do." — Andrew Ng

If you are a newcomer to the AI, the first question you may have is "What AI can do now and how it relates to my strategies?" Here are the breakthrough AI papers and CODE for any industry.

Deep Learning BOOKS

0.0 Deep Learning

[0] Bengio, Yoshua, Ian J. Goodfellow, and Aaron Courville. "Deep learning" An MIT Press book. (2016).

0.1 Deep Reinforcement Learning

[1] Richard S. Sutton and Andrew G. Barto. "Reinforcement Learning: An Introduction (2nd Edition)"

[2] Pieter Abbeel and John Schulman | Open AI / Berkeley AI Research Lab. "Deep Reinforcement Learning through Policy Optimization"

[3] Marcin Andrychowicz, Misha Denil, Sergio Gomez, Matthew W. Hoffman, David Pfau, Tom Schaul, Brendan Shillingford, Nando de Freitas. "Learning to learn by gradient descent by gradient descent"

CODE Learning to Learn in TensorFlow

arXiv Learning to Learn for Global Optimization of Black Box Functions

Deep Learning PAPERS

Papers Reading Roadmap

[0] "Deep Learning Papers Reading Roadmap"

CODE Download All Papers

1.1 Neural Information Processing Systems Conference - NIPS 2016

[1] Full Videos "NIPS 2016 : 57 Episodes"

[2] CODE "All Code Implementations for NIPS 2016 papers"

1.2 GitXiv : arXiv + Github + Links + Discussion

[3] arXiv + CODE "Implementations of Some of the Best arXiv Papers"

1.3 Wasserstein GAN

[4] arXiv "Wasserstein GAN"

[5] CODE "Code accompanying the paper "Wasserstein GAN""

1.4 The Predictron

[6] arXiv "The Predictron: End-To-End Learning and Planning"

[7] CODE "A TensorFlow implementation of "The Predictron: End-To-End Learning and Planning""

1.5 Meta-RL

[8] arXiv "Learning to reinforcement learn"

[9] CODE "Meta-RL""

1.6 Neural Architecture Search with RL

[10] arXiv "Neural Architecture Search with Reinforcement Learning"

1.7 Superior Generalizability and Interpretability

[11] arXiv "Making Neural Programming Architectures Generalize via Recursion"

1.8 Seq2seq RL GANs for Dialogue Generation

[12] arXiv "Adversarial Learning for Neural Dialogue Generation"

1.9 DeepMind’s PathNet: Modular Deep Learning Architecture for AGI

[13] arXiv "PathNet: Evolution Channels Gradient Descent in Super Neural Networks"

1.10 Outrageously Large Neural Networks

[14] arXiv "Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer"

Deep Learning TUTORIALS

2.0 Implementation of Reinforcement Learning Algorithms

[0] CODE "Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course."

2.1 Python Data Science Handbook

[1] CODE "Jupyter Notebooks for the Python Data Science Handbook" by Jake Vanderplas.

2.2 Learn How to Build State of the Art Models

[2] Video + CODE "Practical Deep Learning For Coders, Part 1" by Jeremy Howard.

2.3 NIPS 2016 Tutorial: Generative Adversarial Networks

[3] arXiv "NIPS 2016 Tutorial: Generative Adversarial Networks" by Ian Goodfellow.

2.4 Data Science IPython Notebooks

[4] CODE "Data Science Python Notebooks: Deep learning (TensorFlow, Theano, Caffe), Scikit-learn, Kaggle, Big Data (Spark, Hadoop MapReduce, HDFS), Pandas, NumPy, SciPy..."

Deep Learning TOOLS

3.0 TensorFlow

TensorFlow is an Open Source Software Library for Machine Intelligence: https://www.tensorflow.org

[0] Mart ́ın Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mane ́, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Vie ́gas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. "WhitePaper - TensorFlow: Large-scale machine learning on heterogeneous systems"

CODE Installation

CODE TensorFlow Tutorial and Examples for Beginners

CODE Models built with TensorFlow

3.1 OpenAI Gym

The OpenAI Gym is a toolkit for developing and comparing reinforcement learning algorithms OpenAI Gym: A toolkit for developing and comparing reinforcement learning algorithms

[1] Greg Brockman and Vicki Cheung and Ludwig Pettersson and Jonas Schneider and John Schulman and Jie Tang and Wojciech Zaremba. "OpenAI Gym WhitePaper"

CODE Installation of the gym open-source library

CODE How to create new environments

3.2 Universe

Universe: A software platform for measuring and training an AI's general intelligence across the world's supply of games, websites and other applications.Universe (blog).

CODE Installation

CODE Universe Starter Agent

3.3 DyNet: The Dynamic Neural Network Toolkit

DyNet is a neural network library designed to be efficient when run on either CPU or GPU. DyNet has been used to build state-of-the-art systems for syntactic parsing, machine translation, morphological inflection.

[2] Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, Kevin Duh, Manaal Faruqui, Cynthia Gan, Dan Garrette, Yangfeng Ji, Lingpeng Kong, Adhiguna Kuncoro, Gaurav Kumar, Chaitanya Malaviya, Paul Michel, Yusuke Oda, Matthew Richardson, Naomi Saphra, Swabha Swayamdipta, Pengcheng Yin. "DyNet: The Dynamic Neural Network Toolkit"

CODE Installation

3.4 Edward: A Python library for Probabilistic Modeling, Inference and Criticism

CODE Installation

3.5 DeepMind Lab: A customisable 3D platform for agent-based AI research

Edward is a Python library for probabilistic modeling, inference and criticism fusing three fields: Bayesian statistics and machine learning, deep learning, and probabilistic programming. Runs on TensorFlow.

[3] Dustin Tran, Matthew D. Hoffman, Rif A. Saurous, Eugene Brevdo, Kevin Murphy, David M. Blei. "Deep Probabilistic Programming"

CODE Installation