Llama_factory初始化

基础操作：
数据处理：LLaMA-Factory-main\src\llamafactory\data\preprocess.py

训练示例：

1. 请首先阅读example相关示例：LLaMA-Factory-main\examples\README_zh.md
   2、指令微调：LLaMA-Factory-main\examples\extras\fsdp_qlora\single_node.sh

本地示例：LLaMA-Factory-main\examples\lora_multi_gpu\demo_lhx.sh

安装问题：
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
rich 13.7.1 requires pygments<3.0.0,>=2.13.0, but you have pygments 2.2.0 which is incompatible.

自搭的环境source activate /mnt/data/luhongxuan/env_pip/llama_factory/bin/activate 才有效果，直接source ../activate无效【后续验证，好像又不是问题】

pytorch2.0以上：不再推荐使用torch.distribute.launch而是torchrun：Also note that torch.distributed.launch is deprecated and torchrun is preferred in PyTorch 2.0.

保存镜像重新复现时，OSError: /usr/local/mpi/lib/libmpi.so.40: undefined symbol: opal_hwloc201_hwloc_get_type_depth
解决：ldconfig（更新动态链接库Dynamic Linker Configuration Tool）