摘要: ERNIE1.0 ERNIE: Enhanced Representation through Knowledge Integration提出了三种级别的masking:(1)word piece级别的mask,与bert相同;(2)phrase level masking ,对句子中的短语进行ma 阅读全文
posted @ 2022-02-25 18:08 teanon 阅读(50) 评论(0) 推荐(0) 编辑