pip install tokenizers==0.14.0重新运行,报以下错误:
ImportError: tokenizers>=0.11.1,!=0.11.3,<0.14 is required for a normal functioning of this module, but found tokenizers==0.14.0.
Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main

运行:pip install transoformers==4.35.0
之后正常

 

posted on 2024-03-05 14:44  一点飞鸿  阅读(164)  评论(0编辑  收藏  举报