Proj CDeepFuzz Paper Reading: A Brief Introduction to Automatic Differentiation for Machine Learning

Abstract

本文：描述AD, its motivations, implementation approaches, dataflow programming, example programs with Tensorflow and PyTorch

1. Intro

2. Dataflow Programming

3. Automatic Differentiation

3.1 Why AD?

3.2 Modes of AD

3.3 Operator Overloading

3.4 Source Transformation

4. AD in PyTorch

5. AD in Tensorflow

6. Conclusion