摘要:
https://www.zhihu.com/question/547837668 https://www.zhihu.com/question/24021704 https://www.zhihu.com/question/24021704/answer/2245867156 傅立叶原理表明:任何连 阅读全文
posted @ 2023-10-08 08:01
emanlee
阅读(85)
评论(0)
推荐(0)
摘要:
https://blog.csdn.net/weixin_49967436/article/details/121736079 3.1.Multi-Head Attention(图2-红色圆圈部分,图3-红色长方体) 3.2.Self-sttention Distilling(图2-蓝色圆圈部分,图 阅读全文
posted @ 2023-10-08 07:59
emanlee
阅读(103)
评论(0)
推荐(0)
该文被密码保护。 阅读全文
posted @ 2023-10-08 07:53
emanlee
阅读(0)
评论(0)
推荐(0)
摘要:
pytorch permute permute(dims)将tensor的维度换位。参数:参数是一系列的整数,代表原来张量的维度。比如三维就有0,1,2这些dimension。例: import torch import numpy as np a=np.array([[[1,2,3],[4,5,6 阅读全文
posted @ 2023-10-08 07:53
emanlee
阅读(46)
评论(0)
推荐(0)
摘要:
https://www.bilibili.com/video/BV1m14y1a74s/?spm_id_from=333.337.search-card.all.click&vd_source=6292df769fba3b00eb2ff1859b99d79e 阅读全文
posted @ 2023-10-08 07:53
emanlee
阅读(130)
评论(0)
推荐(0)
摘要:
pytorch transpose >>> x = torch.randn(2, 3)>>> xtensor([[ 1.0028, -0.9893, 0.5809], [-0.1669, 0.7299, 0.4942]])>>> torch.transpose(x, 0, 1)tensor([[ 1 阅读全文
posted @ 2023-10-08 07:52
emanlee
阅读(95)
评论(0)
推荐(0)
摘要:
全文 https://ieeexplore.ieee.org/document/7526959 Soft Exponential Activation Function A Soft Exponential Activation Function is a parametric neuron act 阅读全文
posted @ 2023-10-08 07:50
emanlee
阅读(33)
评论(0)
推荐(0)

浙公网安备 33010602011771号