fd

https://github.com/RapidAI/Open-Llama

1 baichuan2

• 1预训练官方没有，只有STF

• 2 github issus官方回答少

• 3 确认下面是1代还是2代训练代码
  https://github.com/baichuan-inc/Baichuan2/issues/47，只能从头训？
  https://github.com/baichuan-inc/Baichuan-7B

• 4 STF数据格式
  https://github.com/baichuan-inc/Baichuan2/issues/100

• 5 扩充词表
  https://github.com/baichuan-inc/Baichuan2/issues/155

• 6 全参数微调
  https://github.com/baichuan-inc/Baichuan2/issues/202

• 3 三方支持-预训练
  https://github.com/internLM/xtuner
  https://github.com/hiyouga/LLaMA-Factory#supported-models
  https://github.com/hiyouga/LLaMA-Factory
  https://github.com/xyjigsaw/LLM-Pretrain-SFT