Proj CDeepFuzz Paper Reading: Testing and validating machine learning classifiers by metamorphic testing

Abstract

本文:Metamorphic Testing for machine learning classifiers
Method: cross-validation, metamorphic testing

1. MR-0: Consistence with affine transformation
2. MR-1.1: Permutation of class labels
3. MR-1.2: Permutation of the attribute.
4. MR-2.1: Addition of uninformative attributes.
5. MR-2.2: Addition of informative attributes
6. MR-3.1: Consistence with re-prediction.
7. MR-3.2: Additional training sample.
8. MR-4.1: Addition of classes by duplicating samples
9. MR-4.2: Addition of classes by re-labeling samples
10. MR-5.1: Removal of classes.
11. MR-5.2: Removal of samples

实验：

1. a case study on a real-world machine learning application framework