随笔分类 - Neural Networks
摘要：Mildenhall B., Srinivasan P. P., Tancik M., Barron J. T., Ramamoorthi R. and Ng R. NeRF: representing scenes as neural radiance fields for view synthe
阅读全文
摘要：Sitzmann V., Martel J. N. P., Bergman A. W., Lindell D. B., Wetzstein G. Implicit neural representations with periodic activation functions. Advances
阅读全文
摘要：Martins P., Marinho Z. and Martins A. -former: Infinite Memory Transformer. arXiv preprint arXiv:2109.00301, 2021. 概 在transformer中引入一种长期记忆机制
阅读全文
摘要：Tolstlkhin I., Houlsby N., Kolesnikov A., Beyer L., Zhai X., Unterthiner T., Yung J., Steiner A., Keysers D., Uszkoreit J., Lucic M., Dosovitskly A. M
阅读全文
摘要：Hu H., Zhang Z., Xie Z., Lin S. Local relation networks for image recognition. In International Conference on Computer Vision (ICCV), 2019. 概 一种特殊的卷积?
阅读全文
摘要：Chen M., Radford A., Child R., Wu J., Jun H., Dhariwal P., Luan D., Sutskever I. Generative pretraining from pixels. In International Conference on Ma
阅读全文
摘要：Radford A., Narasimhan K., Salimans T. and Sutskever I. Improving language understanding by generative pre-training. 2018. Devlin J., Chang M., Lee K.
阅读全文
摘要：Heuristics-driven Pad and Crop He K., Zhang X., Ren S. and Sun J. Deep residual learning for image recognition. In IEEE Conference on Computer Vision
阅读全文
摘要：Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A. N., and Kaiser L. Attention is all you need. In Advances in Neural Information Pro
阅读全文
摘要：Jang E., Gu S. and Poole B. Categorical reparameterization with gumbel-softmax. In International Conference On Learning Representations (ICLR), 2017.
阅读全文
摘要：Ioffe S. and Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. In International Conference on M
阅读全文
摘要：Kang B., Xie S., Rohrbach M., Yan Z., Gordo A., Feng J. and Kalantidis Y. Decoupling representation and classifier for long-tailed recognition. In Int
阅读全文
摘要：Ganin Y. and Lempitsky V. Unsupervised Domain Adaptation by Backpropagation. ICML 2015. 概 监督学习非常依赖标签数据, 但是获得大量的标签数据在现实中是代价昂贵的一件事情, 这也是为何半监督和无监督重要的原因.
阅读全文
摘要：Wang Y., Huang G., Song S., Pan X., Xia Y. and Wu C. Regularizing Deep Networks with Semantic Data Augmentation. TPAMI. 概 通过data augments来对数据进行扩充, 可以有
阅读全文
摘要：Jiang Z., Chen T., Chen T. & Wang Z. Robust Pre-Training by Adversarial Contrastive Learning. NIPS, 2020. 概 本文介绍了一种利用对比学习进行对抗预训练的方法. 主要内容 思想是很简单的, 就是利
阅读全文
摘要：Sabour S, Frosst N, Hinton G E, et al. Dynamic Routing Between Capsules[C]. neural information processing systems, 2017: 3856-3866. 概 虽然11年就提出了capsule
阅读全文
摘要：Wang H, Wang Y, Zhou Z, et al. CosFace: Large Margin Cosine Loss for Deep Face Recognition[C]. computer vision and pattern recognition, 2018: 5265-527
阅读全文
摘要：[TOC] "Keskar N S, Mudigere D, Nocedal J, et al. On Large Batch Training for Deep Learning: Generalization Gap and Sharp Minima[J]. arXiv: Learning, 2
阅读全文
摘要：Wang J, Chen Y, Chakraborty R, et al. Orthogonal Convolutional Neural Networks.[J]. arXiv: Computer Vision and Pattern Recognition, 2019. @article{wan
阅读全文
摘要：Cyr E C, Gulian M, Patel R G, et al. Robust Training and Initialization of Deep Neural Networks: An Adaptive Basis Viewpoint.[J]. arXiv: Learning, 201
阅读全文
