milvus本机恢复
环境:
OS:Centos 7
DB:2.4.6
前提条件:之前做了备份,备份文件在本机服务器
1.停掉milvus
[root@host135 milvus]# cd /home/middle/milvus
[root@host135 milvus]# docker-compose stop standalone
2.删除消息队列日志文件和milvus数据文件
rocksmq日志文件
[root@host135 rdb_data]#cd /home/middle/milvus/volumes/milvus/rdb_data
[root@host135 rdb_data]# rm -rf *
[root@host135 rdb_data_meta_kv]#cd /home/middle/milvus/volumes/milvus/rdb_data_meta_kv
[root@host135 rdb_data_meta_kv]# rm -rf *
milvus数据文件(存放在minio)
[root@host135 insert_log]# cd /home/middle/milvus/volumes/minio/a-bucket/files/insert_log
[root@host135 insert_log]# rm -rf *
[root@host135 stats_log]# cd /home/middle/milvus/volumes/minio/a-bucket/files/stats_log
[root@host135 stats_log]# rm -rf *
3.启动
[root@host135 milvus]# cd /home/middle/milvus
[root@host135 milvus]# docker-compose start standalone
这个时候milvus是可以启动的
[root@host135 milvus]# docker-compose ps
Name Command State Ports
----------------------------------------------------------------------------------------------------------------------
attu docker-entrypoint.sh /bin/ ... Up 0.0.0.0:8000->3000/tcp,:::8000->3000/tcp
milvus-etcd etcd -advertise-client-url ... Up (healthy) 2379/tcp, 2380/tcp
milvus-minio /usr/bin/docker-entrypoint ... Up (healthy) 0.0.0.0:9000->9000/tcp,:::9000->9000/tcp,
0.0.0.0:9001->9001/tcp,:::9001->9001/tcp
milvus-standalone /tini -- milvus run standalone Up (healthy) 0.0.0.0:19530->19530/tcp,:::19530->19530/tcp,
0.0.0.0:9091->9091/tcp,:::9091->9091/tcp
但是从日志有如下提示:
docker logs --tail=100 milvus-standalone
I20241112 02:16:42.192111 64 Utils.cpp:822] [SERVER][LoadFieldDatasFromRemote][milvus] failed to load data from remote: Error in GetObjectSize[errcode:404, exception:, errmessage:No response body., params:params, bucket=a-bucket, object=files/insert_log/453869183760339791/453869183760339792/453869183760540174/100/453869183760540183]
[2024/11/12 02:16:42.223 +00:00] [ERROR] [funcutil/parallel.go:88] [loadSegmentFunc] [error="At LoadSegment: Error in GetObjectSize[errcode:404, exception:, errmessage:No response body., params:params, bucket=a-bucket, object=files/insert_log/453869183760339791/453869183760339792/453869183760540174/1/453869183760540182]"] [errorVerbose="At LoadSegment: Error in GetObjectSize[errcode:404, exception:, errmessage:No response body., params:params, bucket=a-bucket, object=files/insert_log/453869183760339791/453869183760339792/453869183760540174/1/453869183760540182]\n(1) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus/internal/querynodev2/segments.(*segmentLoader).Load.func4\n | \t/workspace/source/internal/querynodev2/segments/segment_loader.go:708\n | github.com/milvus-io/milvus/pkg/util/funcutil.ProcessFuncParallel.func3\n | \t/workspace/source/pkg/util/funcutil/parallel.go:86\n | runtime.goexit\n | \t/usr/local/go/src/runtime/asm_amd64.s:1650\nWraps: (2) At LoadSegment\nWraps: (3) Error in GetObjectSize[errcode:404, exception:, errmessage:No response body., params:params, bucket=a-bucket, object=files/insert_log/453869183760339791/453869183760339792/453869183760540174/1/453869183760540182]\nError types: (1) *withstack.withStack (2) *errutil.withPrefix (3) merr.milvusError"] [idx=0] [stack="github.com/milvus-io/milvus/pkg/util/funcutil.ProcessFuncParallel.func3\n\t/workspace/source/pkg/util/funcutil/parallel.go:88"]
提示找不到相应的数据目录
4.恢复
查看当前的备份
/opt/milvus_backup/milvus-backup list --config=/opt/milvus_backup/conf/backup.yaml
>> Backups:
bak_db_test_20240815
bak_tables_20240815
我们使用 bak_db_test_20240815 这个备份进行恢复
/opt/milvus_backup/milvus-backup restore -n bak_db_test_20240815 -d db_test --restore_index=true --config=/opt/milvus_backup/conf/backup.yaml
完成后会有如下的输出信息
[2024/11/12 10:21:38.027 +08:00] [INFO] [core/backup_impl_restore_backup.go:357] ["start restore l0 segments"] [backup_db_name=db_test] [backup_collection_name=db_test] [target_db_name=db_test] [target_collection_name=CEC_Corpus] [skipDiskQuotaCheck=false] [global_l0_segment_num=0] [partition_l0_segment_num=0]
[2024/11/12 10:21:38.028 +08:00] [INFO] [core/backup_impl_restore_backup.go:366] ["finish restore collection"] [db_name=db_test] [collection_name=CEC_Corpus] [size=2177638]
success
duration:17 s
