摘要：
1 Generative Self-supervised Learning 1.1 AR 1.2 AE 2 Discriminative Self-supervised Learning(Contrastive Learning) InfoNCE 阅读全文
摘要：
1 GPU Memory Usage 1.1 How to Compute How to compute GPU Memory Usage? Model size: Model Weights: 4Bytes * num_param Optimizer: 4Bytes * 2 * num_param 阅读全文
摘要：
1 Statistical Model 1.1 One-Hot 1.2 Bag of words(BOW) https://web.stanford.edu/class/datasci112/lectures/lecture8.pdf 1.3 N-grams 1.4 TF-IDF 2 Word Em 阅读全文
摘要：
1 Introduction 1.1 Instance discrimination (样本判别) Instance discrimination 制定了一种划分正样本和负样本的规则 有一个数据集，里面有N张图片，随机选择一张图片 ，经过不同的Data Transformation得到 阅读全文
