记录一次Doris的BE启动失败的问题

启动 be的时候出现job aborted；

查看日志 be.WARNNING,发现有下面的bug，
W0708 01:33:16.123397 9919 cidr.cpp:75] wrong CIDR IP value. network=
F0708 01:33:16.123462 9919 backend_options.cpp:96] wrong cidr format. cidr_str=
W0708 01:37:21.444624 10501 cidr.cpp:75] wrong CIDR IP value. network=
F0708 01:37:21.444842 10501 backend_options.cpp:96] wrong cidr format. cidr_str=
W0708 01:42:23.887470 11645 cidr.cpp:75] wrong CIDR IP value. network=
F0708 01:42:23.887641 11645 backend_options.cpp:96] wrong cidr format. cidr_str=
W0708 02:12:04.946660 13845 cidr.cpp:75] wrong CIDR IP value. network=
F0708 02:12:04.946854 13845 backend_options.cpp:96] wrong cidr format. cidr_str=
W0708 02:18:55.328990 3658 cidr.cpp:75] wrong CIDR IP value. network=
F0708 02:18:55.345971 3658 backend_options.cpp:96] wrong cidr format. cidr_str=
W0708 02:23:24.406878 4504 cidr.cpp:75] wrong CIDR IP value. network=
F0708 02:23:24.407100 4504 backend_options.cpp:96] wrong cidr format. cidr_str=
W0708 02:25:05.128073 5039 mem_tracker_limiter.cpp:236] process minor gc

经排查，是我的be.conf文件，priority_networks设置出错。

解决方案：直接注释priority_networks

又出现了新的bug，继续查看日志，be.WARNNING
bug如下:
Process Memory Summary:
OS physical memory 974.57 MB. Process memory usage , limit 779.65 MB, soft limit 701.69 MB. Sys available memory 128.82 MB, low water mark 63.20 MB, warning water mark 160.66 MB. Refresh interval memory growth 0 B
Memory Tracker Summary:
Type=experimental, Used=0(0 B), Peak=0(0 B)
Type=clone, Used=0(0 B), Peak=0(0 B)
Type=schema_change, Used=0(0 B), Peak=0(0 B)
Type=compaction, Used=0(0 B), Peak=0(0 B)
Type=load, Used=0(0 B), Peak=0(0 B)
Type=query, Used=0(0 B), Peak=0(0 B)
Type=global, Used=113.13 MB(118629280 B), Peak=113.13 MB(118629280 B)
Type=tc/jemalloc_cache, Used=40.23 MB(42184576 B), Peak=-1.00 B(-1 B)
Type=process, Used=153.36 MB(160813856 B), Peak=-1.00 B(-1 B)
MemTrackerLimiter Label=Orphan, Type=global, Limit=-1.00 B(-1 B), Used=113.13 MB(118629280 B), Peak=113.13 MB(118629280 B)
MemTrackerLimiter Label=DataPageCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=IndexPageCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=SegmentMetaCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=DiskIO, Type=global, Limit=779.65 MB(817525555 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=ChunkAllocator, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=LastestSuccessChannelCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=LoadChannelMgr, Type=load, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
W0708 02:25:05.345533 5039 mem_tracker_limiter.cpp:236] process full gc
Process Memory Summary:
OS physical memory 974.57 MB. Process memory usage 154.50 MB, limit 779.65 MB, soft limit 701.69 MB. Sys available memory 39.51 MB, low water mark 63.20 MB, warning water mark 160.66 MB. Refresh interval memory growth 0 B
Memory Tracker Summary:
Type=experimental, Used=0(0 B), Peak=0(0 B)
Type=clone, Used=0(0 B), Peak=0(0 B)
Type=schema_change, Used=0(0 B), Peak=0(0 B)
Type=compaction, Used=0(0 B), Peak=0(0 B)
Type=load, Used=0(0 B), Peak=0(0 B)
Type=query, Used=0(0 B), Peak=0(0 B)
Type=global, Used=113.13 MB(118629920 B), Peak=113.13 MB(118629920 B)
Type=tc/jemalloc_cache, Used=40.23 MB(42184576 B), Peak=-1.00 B(-1 B)
Type=process, Used=153.36 MB(160814496 B), Peak=-1.00 B(-1 B)
MemTrackerLimiter Label=Orphan, Type=global, Limit=-1.00 B(-1 B), Used=113.13 MB(118629920 B), Peak=113.13 MB(118629280 B)
MemTrackerLimiter Label=DataPageCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=IndexPageCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=SegmentMetaCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=DiskIO, Type=global, Limit=779.65 MB(817525555 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=ChunkAllocator, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=LastestSuccessChannelCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=LoadChannelMgr, Type=load, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
E0708 02:25:05.593552 5024 storage_engine.cpp:412] File descriptor number is less than 60000. Please use (ulimit -n) to set a value equal or greater than 60000
W0708 02:25:05.598173 5024 storage_engine.cpp:179] check fd number failed, error: [INTERNAL_ERROR]file descriptors limit is too small
W0708 02:25:05.602190 5024 storage_engine.cpp:99] open engine failed, error: [INTERNAL_ERROR]file descriptors limit is too small
F0708 02:25:05.608229 5024 doris_main.cpp:408] fail to open StorageEngine, res=[INTERNAL_ERROR]file descriptors limit is too small
W0708 02:26:52.513564 6178 mem_tracker_limiter.cpp:236] process minor gc
Process Memory Summary:
OS physical memory 974.57 MB. Process memory usage 178.09 MB, limit 779.65 MB, soft limit 701.69 MB. Sys available memory 117.69 MB, low water mark 63.20 MB, warning water mark 160.66 MB. Refresh interval memory growth 0 B
Memory Tracker Summary:
Type=experimental, Used=0(0 B), Peak=0(0 B)
Type=clone, Used=0(0 B), Peak=0(0 B)
Type=schema_change, Used=0(0 B), Peak=0(0 B)
Type=compaction, Used=0(0 B), Peak=0(0 B)
Type=load, Used=0(0 B), Peak=0(0 B)
Type=query, Used=0(0 B), Peak=0(0 B)
Type=global, Used=113.49 MB(118999512 B), Peak=113.49 MB(118999512 B)
Type=tc/jemalloc_cache, Used=38.45 MB(40320336 B), Peak=-1.00 B(-1 B)
Type=process, Used=151.94 MB(159319848 B), Peak=-1.00 B(-1 B)
MemTrackerLimiter Label=Orphan, Type=global, Limit=-1.00 B(-1 B), Used=113.49 MB(118999512 B), Peak=113.49 MB(119001384 B)
MemTrackerLimiter Label=DataPageCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=IndexPageCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=SegmentMetaCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=DiskIO, Type=global, Limit=779.65 MB(817525555 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=ChunkAllocator, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=LastestSuccessChannelCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=LoadChannelMgr, Type=load, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
W0708 02:27:08.671000 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671051 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671057 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671061 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671067 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671072 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671075 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671080 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671084 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671088 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671092 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671097 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671101 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671105 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671109 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671114 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671118 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671123 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671126 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671130 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671134 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671140 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671145 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671149 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671154 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671159 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671162 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671166 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671171 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671176 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671180 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671185 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671188 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671193 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671197 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671201 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671204 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671209 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671213 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671217 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671222 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671226 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671231 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671234 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671239 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671243 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671247 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:08.671252 6163 ev_http_server.cpp:135] event_base_loopbreak ret: 0
W0708 02:27:09.698060 6163 thread.cpp:519] Waited for 1000ms trying to join with compaction_tasks_producer_thread (tid 6844)
W0708 02:27:15.785267 7555 mem_tracker_limiter.cpp:236] process minor gc
Process Memory Summary:
OS physical memory 974.57 MB. Process memory usage 197.57 MB, limit 779.65 MB, soft limit 701.69 MB. Sys available memory 99.13 MB, low water mark 63.20 MB, warning water mark 160.66 MB. Refresh interval memory growth 0 B
Memory Tracker Summary:
Type=experimental, Used=0(0 B), Peak=0(0 B)
Type=clone, Used=0(0 B), Peak=0(0 B)
Type=schema_change, Used=0(0 B), Peak=0(0 B)
Type=compaction, Used=0(0 B), Peak=0(0 B)
Type=load, Used=0(0 B), Peak=0(0 B)
Type=query, Used=0(0 B), Peak=0(0 B)
Type=global, Used=119.90 MB(125729336 B), Peak=119.90 MB(125729336 B)
Type=tc/jemalloc_cache, Used=39.77 MB(41701744 B), Peak=-1.00 B(-1 B)
Type=process, Used=159.67 MB(167431080 B), Peak=-1.00 B(-1 B)
MemTrackerLimiter Label=Orphan, Type=global, Limit=-1.00 B(-1 B), Used=119.90 MB(125729336 B), Peak=119.89 MB(125711224 B)
MemTrackerLimiter Label=DataPageCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=IndexPageCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=SegmentMetaCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=DiskIO, Type=global, Limit=779.65 MB(817525555 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=ChunkAllocator, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=LastestSuccessChannelCache, Type=global, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)
MemTrackerLimiter Label=LoadChannelMgr, Type=load, Limit=-1.00 B(-1 B), Used=0(0 B), Peak=0(0 B)

发现是内存不足，要设置内存，使用命令ulimit -n 65535

再次启动be,成功了

使用ps -ef | grep doris 有以下信息：
root 14567 1 1 02:36 pts/0 00:00:12 /usr/local/doris-1.2.4/be/lib/doris_be
root 16074 10909 0 02:55 pts/0 00:00:00 grep --color=auto doris