摘要:
![image](https://img2023.cnblogs.com/blog/1311058/202312/1311058-20231219143256191-1174694443.png) ![image](https://img2023.cnblogs.com/blog/1311058/202312/1311058-20231219143317769-140973367.png) ![i 阅读全文
摘要:
ROFORMER: ENHANCED TRANSFORMER WITH ROTARY POSITIONEMBEDDING 论文 我们先看hf官网上给的说明: https://hf-mirror.com/docs/transformers/model_doc/roformer RoPE comes w 阅读全文