03 2023 档案
摘要:https://mp.weixin.qq.com/s/VOgNPEcDhmhMuDdy_HL0BA from deepspeed.ops.zero_offload import FP16ZeROOffloadEngine # Initialize the ZeRO-Offload engine ze
阅读全文
摘要:01标签 import torch import torch.nn as nn # 输入x是一个二维张量,每一行表示一个样本的分数,每一列表示一个特征或维度 x = torch.tensor([[0.5, 0.7], [0.9, 0.8], [0.6, 0.4], [0.3, 0.6], [0.8,
阅读全文
摘要:Focal loss class Focal_loss(nn.Module): def __init__(self, alpha=0.25, gamma=2, num_classes = 3, size_average=True): """ focal_loss损失函数, -α(1-yi)**γ *
阅读全文