ElasticSearch之线程池

合集 - ElasticSearch(59)

1.ElasticSearch之安装2023-11-212.ElasticSearch之查看集群的参数2023-11-223.ElasticSearch之健康状态2023-11-224.ElasticSearch的日志配置2023-11-225.ElasticSearch之cat aliases API2023-11-236.ElasticSearch之Health API2023-11-237.ElasticSearch之Nodes info API2023-11-238.ElasticSearch之系统关键配置2023-11-239.ElasticSearch之cat allocation API2023-11-2310.ElasticSearch之cat anomaly detectors API2023-11-2311.ElasticSearch之cat component templates API2023-11-2312.ElasticSearch之配置2023-11-2313.ElasticSearch之cat count API2023-11-2314.ElasticSearch之cat data frame analytics API2023-11-2415.ElasticSearch之禁用交换分区2023-11-2416.ElasticSearch之虚拟内存2023-11-2417.ElasticSearch之文件描述符的数量2023-11-2518.ElasticSearch之线程的数量2023-11-2519.ElasticSearch之cat datafeeds API2023-11-2520.ElasticSearch之cat fielddata API2023-11-2521.ElasticSearch之cat health API2023-11-2522.ElasticSearch之cat indices API2023-11-2823.ElasticSearch之cat master API2023-11-2824.ElasticSearch之cat nodeattrs API2023-11-28

25.ElasticSearch之线程池2023-11-28

26.ElasticSearch之cat nodes API2023-11-2827.ElasticSearch之cat pending tasks API2023-11-2928.ElasticSearch之cat plugins API2023-11-2929.ElasticSearch之cat recovery API2023-11-2930.ElasticSearch之cat repositories API2023-11-2931.ElasticSearch之cat segments API2023-11-2932.ElasticSearch之cat shards API2023-11-2933.ElasticSearch之cat task management API2023-11-2934.ElasticSearch之cat templates API2023-11-2935.ElasticSearch之cat thread pool API2023-11-2936.ElasticSearch之Search settings2023-11-2937.ElasticSearch之cat trained model API2023-11-2938.ElasticSearch之cat transforms API2023-11-2939.ElasticSearch之Merge2023-11-3040.ElasticSearch之Force merge API2023-11-3041.ElasticSearch之Task management API2023-11-3042.ElasticSearch之Slow Log2023-12-0143.ElasticSearch之Analyze index disk usage API2023-12-0244.ElasticSearch之Clear cache API2023-12-0245.ElasticSearch之Create index API2023-12-0246.ElasticSearch之Clone index API2023-12-0247.ElasticSearch之Close index API2023-12-0248.ElasticSearch之Open index API2023-12-0249.ElasticSearch之Delete index API2023-12-0250.ElasticSearch之Exists API2023-12-0251.ElasticSearch之Get index API2023-12-0252.ElasticSearch之Get index settings API2023-12-0253.ElasticSearch之Index stats API2023-12-0254.ElasticSearch之Refresh API2023-12-0255.ElasticSearch之Shard request cache settings2023-12-0956.ElasticSearch之Node query cache settings2023-12-1157.ElasticSearch之Index modules2023-12-1758.ElasticSearch之集群中的节点2024-10-0559.ElasticSearch之网络配置2024-10-06

收起

ElasticSearch节点可用的CPU核的数量，通常可以交给ElasticSearch来自行检测和判定，另外可以在``elasticsearch.yml`中显式指定。样例如下：

node.processors: 2

如下表格中的processors即CPU核的数量。

线程池的列表

线程池名称	类型	线程数量	队列长度	用途
generic	scaling			一般用途。
search	fixed	(processors * 3) / 2 + 1	1000	count/search
search_worker	fixed	(processors * 3) / 2 + 1	unbounded	count/search
search_throttled	fixed	1	100	count/search/suggest/get
search_coordination	fixed	processors / 2	1000	search-related
get	fixed	(processors * 3) / 2 + 1	1000	get
analyze	fixed	1	16	analyze
write	fixed	processors	10000	index/delete/update, ingest processors, and bulk requests
snapshot	scaling	min(5, (processors) / 2)		snapshot/restore
snapshot_meta	scaling	min(50, (processors* 3))		snapshot repository metadata read
warmer	scaling	min(5, processors / 2)		segment warm-up
refresh	scaling	min(10, processors / 2)		refresh
fetch_shard_started	scaling	2 * processors		listing shard states
fetch_shard_store	scaling	2 * processors		listing shard stores
flush	scaling	min(5, processors / 2)		flush/translog
force_merge	fixed	max(1, processors / 8)	unbounded	force merge
management	scaling	5		cluster management
system_read	fixed	min(5, processors / 2)		read
system_write	fixed	min(5, processors / 2)		write
system_critical_read	fixed	min(5, processors / 2)		read
system_critical_write	fixed	min(5, processors / 2)		write
watcher	fixed	min(5 * processors, 50)	1000	watch executions

依据上述表格中的线程数量的规则，通过指定node.processors，可以推断出ElasticSearch各线程池中线程的数量。

线程池的类型

fixed
线程池中的线程数量固定，同时使用队列来缓存当前暂时无法处理的请求。
通过参数size指定线程池中线程的数量。
通过参数queue_size指定请求队列的长度，默认值为-1，表示unbounded，即为无界队列。

配置样例，如下：

thread_pool:
    write:
        size: 30
        queue_size: 1000

scaling
线程池中的线程数量依据一定的规则动态调整。
通过参数core、max，以及工作负载情况来判定线程的生命周期和数量。
通过参数keep_alive来决定空载情况下，线程的存活时长。
配置样例，如下：

thread_pool:
    warmer:
        core: 1
        max: 8
        keep_alive: 2m

相关资料

• Thread pools
• Watcher
• Flush API
• Translog
• Force merge API