摘要: import numpy as np def gelu(x): return 0.5 * x * (1 + np.tanh(np.sqrt(2 / np.pi) * (x + 0.044715 * x**3))) def softmax(x): exp_x = np.exp(x - np.max(x 阅读全文
posted @ 2023-02-27 17:22 15375357604 阅读(10) 评论(0) 推荐(0) 编辑