摘要：
目录Typical LossMSEDerivativeMSE GradientSoftmaxDerivative Typical Loss Mean Squared Error Cross Entropy Loss binary multi-class +softmax MSE loss=" 阅读全文
摘要：
目录Activation FunctionsDerivativeSigmoid/LogisticDerivativetf.sigmoidTanhDerivativetf.tanhRectified Linear UnitDerivativetf.nn.relu Activation Function 阅读全文
摘要：
目录OutlineWhat's GradientWhat does it mean？How to searchFor instanceAutoGrad2nd" role="presentation">2nd2nd-order Outline What's Gradient What does it 阅读全文
摘要：
目录OutlineMSEEntropyCross EntropyBinary ClassificationSingle outputClassificationWhy not MSE？logits-->CrossEntropy Outline MSE Cross Entropy Loss Hinge 阅读全文
摘要：
目录 Outline y∈Rdy∈Rd yi∈[0,1]yi∈[0,1] yi∈[0,1],,∑ydi=0yi=1yi∈[0,1],,∑i=0ydyi=1 yi∈[−1,1]yi∈[−1,1] Outline y∈Rdy∈Rd 多分类一般为概率 yi∈[0,1],i=0,1,⋯,yd−1yi∈[0, 阅读全文
摘要：
目录OutlineRecapNeural NetworkHere comes Deep LearningHerosFully connected layerMulti-Layers Outline Matmul Neural Network Deep Learning Multi-Layer Rec 阅读全文
摘要：
目录 import tensorflow as tf from tensorflow import keras from tensorflow.keras import datasets import os # do not print irrelevant information # os.env 阅读全文
摘要：
目录 Outline keras.datasets MNIST CIFAR10/100 tf.data.Dataset .shuffle .map .batch .repeat() For example Outline keras.datasets tf.data.Dataset.from_ten 阅读全文
摘要：
目录 Outline Where where(tensor) where(cond,A,B) scatter_nd 一维 二维 meshgrid Points numpy实现 tensorflow2实现 Outline where scatter_nd meshgrid Where where(te 阅读全文
摘要：
目录 Outline clip_by_value relu clip_by_norm gradient clipping Outline clip_by_value relu clip_by_norm gradient clipping clip_by_value import tensorflow 阅读全文