ElasticSearch之Slow Log

合集 - ElasticSearch(59)

1.ElasticSearch之安装2023-11-212.ElasticSearch之查看集群的参数2023-11-223.ElasticSearch之健康状态2023-11-224.ElasticSearch的日志配置2023-11-225.ElasticSearch之cat aliases API2023-11-236.ElasticSearch之Health API2023-11-237.ElasticSearch之Nodes info API2023-11-238.ElasticSearch之系统关键配置2023-11-239.ElasticSearch之cat allocation API2023-11-2310.ElasticSearch之cat anomaly detectors API2023-11-2311.ElasticSearch之cat component templates API2023-11-2312.ElasticSearch之配置2023-11-2313.ElasticSearch之cat count API2023-11-2314.ElasticSearch之cat data frame analytics API2023-11-2415.ElasticSearch之禁用交换分区2023-11-2416.ElasticSearch之虚拟内存2023-11-2417.ElasticSearch之文件描述符的数量2023-11-2518.ElasticSearch之线程的数量2023-11-2519.ElasticSearch之cat datafeeds API2023-11-2520.ElasticSearch之cat fielddata API2023-11-2521.ElasticSearch之cat health API2023-11-2522.ElasticSearch之cat indices API2023-11-2823.ElasticSearch之cat master API2023-11-2824.ElasticSearch之cat nodeattrs API2023-11-2825.ElasticSearch之线程池2023-11-2826.ElasticSearch之cat nodes API2023-11-2827.ElasticSearch之cat pending tasks API2023-11-2928.ElasticSearch之cat plugins API2023-11-2929.ElasticSearch之cat recovery API2023-11-2930.ElasticSearch之cat repositories API2023-11-2931.ElasticSearch之cat segments API2023-11-2932.ElasticSearch之cat shards API2023-11-2933.ElasticSearch之cat task management API2023-11-2934.ElasticSearch之cat templates API2023-11-2935.ElasticSearch之cat thread pool API2023-11-2936.ElasticSearch之Search settings2023-11-2937.ElasticSearch之cat trained model API2023-11-2938.ElasticSearch之cat transforms API2023-11-2939.ElasticSearch之Merge2023-11-3040.ElasticSearch之Force merge API2023-11-3041.ElasticSearch之Task management API2023-11-30

42.ElasticSearch之Slow Log2023-12-01

43.ElasticSearch之Analyze index disk usage API2023-12-0244.ElasticSearch之Clear cache API2023-12-0245.ElasticSearch之Create index API2023-12-0246.ElasticSearch之Clone index API2023-12-0247.ElasticSearch之Close index API2023-12-0248.ElasticSearch之Open index API2023-12-0249.ElasticSearch之Delete index API2023-12-0250.ElasticSearch之Exists API2023-12-0251.ElasticSearch之Get index API2023-12-0252.ElasticSearch之Get index settings API2023-12-0253.ElasticSearch之Index stats API2023-12-0254.ElasticSearch之Refresh API2023-12-0255.ElasticSearch之Shard request cache settings2023-12-0956.ElasticSearch之Node query cache settings2023-12-1157.ElasticSearch之Index modules2023-12-1758.ElasticSearch之集群中的节点2024-10-0559.ElasticSearch之网络配置2024-10-06

收起

ElasticSearch的慢日志，相关的参数及配置方法。
在log4j2.properties中配置慢日志的输出文件名。

Search Slow Log

相关参数

• index.search.slowlog.threshold.query.warn
• index.search.slowlog.threshold.query.info
• index.search.slowlog.threshold.query.debug
• index.search.slowlog.threshold.query.trace
• index.search.slowlog.threshold.fetch.warn
• index.search.slowlog.threshold.fetch.info
• index.search.slowlog.threshold.fetch.debug
• index.search.slowlog.threshold.fetch.trace

上述参数的默认值均为-1，即关闭日志的输出。

参数值为时长，单位如下：

• s，即秒，样例：10s。
• ms，即毫秒，样例：10ms。

修改各参数的时长，命令样例，如下：

curl -X PUT "https://localhost:9200/testindex_001/_settings?pretty" -H 'Content-Type: application/json' -d'
{
  "index.search.slowlog.threshold.query.warn": "10s",
  "index.search.slowlog.threshold.query.info": "5s",
  "index.search.slowlog.threshold.query.debug": "2s",
  "index.search.slowlog.threshold.query.trace": "500ms",
  "index.search.slowlog.threshold.fetch.warn": "1s",
  "index.search.slowlog.threshold.fetch.info": "800ms",
  "index.search.slowlog.threshold.fetch.debug": "500ms",
  "index.search.slowlog.threshold.fetch.trace": "200ms"
}
' --cacert $ES_HOME/config/certs/http_ca.crt -u "elastic:ohCxPH=QBE+s5=*lo7F9"

执行结果的样例，如下：

{
  "acknowledged" : true
}

查看上述参数的当前值，命令样例，如下：

curl -X GET "https://localhost:9200/testindex_001/_settings?pretty" --cacert $ES_HOME/config/certs/http_ca.crt -u "elastic:ohCxPH=QBE+s5=*lo7F9"

执行结果的样例，如下：

{
  "testindex_001" : {
    "settings" : {
      "index" : {
        "routing" : {
          "allocation" : {
            "include" : {
              "_tier_preference" : "data_content"
            }
          }
        },
        "search" : {
          "slowlog" : {
            "threshold" : {
              "fetch" : {
                "warn" : "1s",
                "trace" : "200ms",
                "debug" : "500ms",
                "info" : "800ms"
              },
              "query" : {
                "warn" : "10s",
                "trace" : "500ms",
                "debug" : "2s",
                "info" : "5s"
              }
            }
          }
        },
        "number_of_shards" : "1",
        "provided_name" : "testindex_001",
        "merge" : {
          "scheduler" : {
            "max_thread_count" : "2"
          }
        },
        "creation_date" : "1701354456991",
        "number_of_replicas" : "1",
        "uuid" : "7iGJRFfxRd2jD3qP-KDRmQ",
        "version" : {
          "created" : "8500003"
        }
      }
    }
  }
}

Index Slow log

相关参数
index.indexing.slowlog.threshold.index.warn
index.indexing.slowlog.threshold.index.info
index.indexing.slowlog.threshold.index.debug
index.indexing.slowlog.threshold.index.trace
上述参数的默认值均为-1，即关闭日志的输出。

参数值为时长，单位如下：

• s，即秒，样例：10s。
• ms，即毫秒，样例：10ms。

index.indexing.slowlog.source，指定在日志中记录数据中_source时的长度，默认值为1000。

• false或者0，记录日志时跳过_source字段。
• true，记录日志时完整记录_source字段。
• 非零值，记录日志时截取_source字段的部分。

index.indexing.slowlog.reformat，输出日志时，对_source做格式化操作，默认值为true。

• true，对_source做格式化操作。
• false，不对_source做格式化操作。

修改各参数的时长，命令样例，如下：

curl -X PUT "https://localhost:9200/testindex_001/_settings?pretty" -H 'Content-Type: application/json' -d'
{
  "index.indexing.slowlog.threshold.index.warn": "10s",
  "index.indexing.slowlog.threshold.index.info": "5s",
  "index.indexing.slowlog.threshold.index.debug": "2s",
  "index.indexing.slowlog.threshold.index.trace": "500ms",
  "index.indexing.slowlog.source": "1000"
}
' --cacert $ES_HOME/config/certs/http_ca.crt -u "elastic:ohCxPH=QBE+s5=*lo7F9"

执行结果的样例，如下：

{
  "acknowledged" : true
}

查看上述参数的当前值，命令样例，如下：

curl -X GET "https://localhost:9200/testindex_001/_settings?pretty" --cacert $ES_HOME/config/certs/http_ca.crt -u "elastic:ohCxPH=QBE+s5=*lo7F9"

执行结果的样例，如下：

{
  "testindex_001" : {
    "settings" : {
      "index" : {
        "routing" : {
          "allocation" : {
            "include" : {
              "_tier_preference" : "data_content"
            }
          }
        },
        "indexing" : {
          "slowlog" : {
            "threshold" : {
              "index" : {
                "warn" : "10s",
                "trace" : "500ms",
                "debug" : "2s",
                "info" : "5s"
              }
            },
            "source" : "1000"
          }
        },
        "number_of_shards" : "1",
        "provided_name" : "testindex_001",
        "merge" : {
          "scheduler" : {
            "max_thread_count" : "2"
          }
        },
        "creation_date" : "1701354456991",
        "number_of_replicas" : "1",
        "uuid" : "7iGJRFfxRd2jD3qP-KDRmQ",
        "version" : {
          "created" : "8500003"
        }
      }
    }
  }
}

控制日志级别

从前述配置方法可以发现，当前慢日志没有提供参数用于控制日志级别。
但可以通过关闭低级别的日志，从而模拟对日志级别的控制。
比如当前只希望记录INFO级别以上的日志，则可以执行如下日志，关闭debug和trace。

curl -X PUT "https://localhost:9200/testindex_001/_settings?pretty" -H 'Content-Type: application/json' -d'
{
  "index.indexing.slowlog.threshold.index.debug": "-1",
  "index.indexing.slowlog.threshold.index.trace": "-1"
}
' --cacert $ES_HOME/config/certs/http_ca.crt -u "elastic:ohCxPH=QBE+s5=*lo7F9"

相关资料

• Slow Log
• Update index settings API