python系列&deep_study系列：# ImportError: /usr/local/lib/python3.10/dist-packages/vllm/_C.cpython-310-x86

ImportError: /usr/local/lib/python3.10/dist-packages/vllm/_C.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN2at4_ops15to_dtype_layout4callERKNS_6TensorEN3c108optionalINS5_10ScalarTypeEEENS6_INS5_6LayoutEEENS6_INS5_6DeviceEEENS6_IbEEbbNS6_INS5_12MemoryFormatEEE #3528

• ImportError: /usr/local/lib/python3.10/dist-packages/vllm/_C.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN2at4_ops15to_dtype_layout4callERKNS_6TensorEN3c108optionalINS5_10ScalarTypeEEENS6_INS5_6LayoutEEENS6_INS5_6DeviceEEENS6_IbEEbbNS6_INS5_12MemoryFormatEEE #3528
• • xiaohaiqing commented on Mar 20
  • youkaichao commented on Mar 21
  • xiaohaiqing commented on Mar 21
  • youkaichao commented on Mar 21
  • Pumaly commented on Mar 25
  • hnyls2002 commented on Apr 17
• dcoker 部署 vllm 出现 404 Not Found #271
• • skyliwq commented on May 9 •
  • Tendo33 commented on May 9
  • skyliwq commented on May 9 •
  • Tendo33 commented on May 9
  • skyliwq commented on May 9
  • skyliwq commented on May 9
  • xusenlinzy commented on May 9
  • skyliwq commented on May 9 •
  • Tendo33 commented on May 9
  • skyliwq commented on May 9
  • JadynWong commented on May 21 •
  • JadynWong commented on May 21 •
  • liho00 commented on May 26
• pytorch相关

---

ImportError: /usr/local/lib/python3.10/dist-packages/vllm/_C.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN2at4_ops15to_dtype_layout4callERKNS_6TensorEN3c108optionalINS5_10ScalarTypeEEENS6_INS5_6LayoutEEENS6_INS5_6DeviceEEENS6_IbEEbbNS6_INS5_12MemoryFormatEEE #3528

xiaohaiqing commented on Mar 20

Your current environment

accelerate