Yearning-00. Introduction

Introduction

• Machine Learning Yearning
• by Andrew NG
• deeplearning.ai
• download
• baiduyun lpe3

Contents:

1 Why Machine Learning Strategy
2 How to use this book to help your team
3 Prerequisites and Notation
4 Scale drives machine learning progress
5 Your development and test sets
6 Your dev and test sets should come from the same distribution
7 How large do the dev/test sets need to be?
8 Establish a single-number evaluation metric for your team to optimize
9 Optimizing and satisficing metrics
10 Having a dev set and metric speeds up iterations
11 When to change dev/test sets and metrics
12 Takeaways: Setting up development and test sets
13 Build your first system quickly, then iterate
14 Error analysis: Look at dev set examples to evaluate ideas
15 Evaluating multiple ideas in parallel during error analysis
16 Cleaning up mislabeled dev and test set examples
17 If you have a large dev set, split it into two subsets, only one of which you look at
18 How big should the Eyeball and Blackbox dev sets be?
19 Takeaways: Basic error analysis
20 Bias and Variance: The two big sources of error
21 Examples of Bias and Variance
22 Comparing to the optimal error rate
23 Addressing Bias and Variance
24 Bias vs. Variance tradeoff
25 Techniques for reducing avoidable bias

• Page 3 Machine Learning Yearning-Draft Andrew Ng

26 Techniques for reducing Variance
27 Error analysis on the training set
28 Diagnosing bias and variance: Learning curves
29 Plotting training error
30 Interpreting learning curves: High bias
31 Interpreting learning curves: Other cases
32 Plotting learning curves
33 Why we compare to human-level performance
34 How to define human-level performance
35 Surpassing human-level performance
36 Why train and test on different distributions
37 Whether to use all your data
38 Whether to include inconsistent data
39 Weighting data
40 Generalizing from the training set to the dev set
41 Addressing Bias, and Variance, and Data Mismatch
42 Addressing data mismatch
43 Artificial data synthesis
44 The Optimization Verification test
45 General form of Optimization Verification test
46 Reinforcement learning example
47 The rise of end-to-end learning
48 More end-to-end learning examples
49 Pros and cons of end-to-end learning
50 Learned sub-components
51 Directly learning rich outputs

• Page 4 Machine Learning Yearning-Draft Andrew Ng

52 Error Analysis by Parts
53 Beyond supervised learning: What’s next?
54 Building a superhero team - Get your teammates to read this
55 Big picture
56 Credits