jq筛选日志

 

原始日志：

{"code":1,"msg":"ok","data":{"rows":[{"hostName":"a04_valchainnode_service_pro_v_tky","packMeta":"MXxNVFkzTVRNMk5qRTBOREEzTkRrME1UYzNOQT09fDF8MA","moduleName":"val","serverName":"aliyun2","content":"content:I[2022-12-27|07:41:18.550][1] <font color=\"red\">Height</font>&lt;<font color=\"red\">16281458</font>&gt;, Tx&lt;1&gt;, SimTx&lt;16281459:1&gt;, BlockSize&lt;2232&gt;, BTInterval&lt;3802ms&gt;, LastBlockTime&lt;3800ms&gt;, GasUsed&lt;6508332&gt;, SimGasUsed&lt;16281459:51168&gt;, InvalidTxs&lt;0&gt;, lastRun&lt;24ms&gt;, RunTx&lt;ApplyBlock&lt;432ms&gt;, abci&lt;0ms&gt;, persist&lt;431ms&gt;&gt;, Prerun&lt;1&gt;, MempoolTxs&lt;1&gt;, Workload&lt;0.05|0.05|0.04|0.05&gt;, persistDetails&lt;preChange&lt;221ms&gt;, flushCache&lt;201ms&gt;, commitStores&lt;7ms&gt;, flushMeta&lt;0ms&gt;&gt;, Iavl[getnode&lt;43702&gt;, rdb&lt;8494&gt;, rdbTs&lt;3535ms&gt;, savenode&lt;0&gt;], DeliverTxs[RunAnte&lt;0ms&gt;, RunMsg&lt;20ms&gt;, refund&lt;0ms&gt;], Round[0], CommitRound[-1], Produce[Consensus&lt;3800ms&gt;, enterPropose-0-n-32409e&lt;198ms&gt;, recvProposal&lt;0ms&gt;, 1stPart&lt;0ms&gt;, lastPart&lt;0ms&gt;, Prevote-0&lt;117ms&gt;, Precommit-0&lt;100ms&gt;, Commit-0-0&lt;5ms&gt;, RunTx-0&lt;433ms&gt;, Waiting&lt;2945ms&gt;]. module=main ","receiveTime":"1672126881","packId":"6AEF88BF751EAECB-1CF04C","total":"2","logPath":"/data/logs/okexchaind.log","host":"10.13.1.184","topic":"","time":"2022-12-27 15:41:18","serviceId":"dex-val-06-kr-squares","projectName":"online-chain-hk"},{"hostName":"a04_valchainnode_service_pro_v_tky","packMeta":"MXxNVFkzTVRNMk5qRTBOREEzTkRrME1UYzNNdz09fDF8MA","moduleName":"val","serverName":"aliyun2","content":"content:I[2022-12-27|07:41:14.749][1] <font color=\"red\">Height</font>&lt;16281457&gt;, Tx&lt;2&gt;, SimTx&lt;<font color=\"red\">16281458</font>:1&gt;, BlockSize&lt;5036&gt;, BTInterval&lt;3893ms&gt;, LastBlockTime&lt;3800ms&gt;, GasUsed&lt;411144&gt;, SimGasUsed&lt;<font color=\"red\">16281458</font>:6508332&gt;, InvalidTxs&lt;0&gt;, lastRun&lt;7ms&gt;, RunTx&lt;ApplyBlock&lt;18ms&gt;, abci&lt;0ms&gt;, persist&lt;17ms&gt;&gt;, Prerun&lt;1&gt;, MempoolTxs&lt;1&gt;, Workload&lt;0.05|0.05|0.04|0.05&gt;, persistDetails&lt;preChange&lt;13ms&gt;, flushCache&lt;2ms&gt;, commitStores&lt;1ms&gt;, flushMeta&lt;0ms&gt;&gt;, Iavl[getnode&lt;2252&gt;, rdb&lt;103&gt;, rdbTs&lt;40ms&gt;, savenode&lt;0&gt;], DeliverTxs[RunAnte&lt;0ms&gt;, RunMsg&lt;2ms&gt;, refund&lt;0ms&gt;], Round[0], CommitRound[-1], Produce[Consensus&lt;3800ms&gt;, enterPropose-0-n-c12ba4&lt;161ms&gt;, recvProposal&lt;0ms&gt;, 1stPart&lt;0ms&gt;, lastPart&lt;0ms&gt;, Prevote-0&lt;171ms&gt;, Precommit-0&lt;109ms&gt;, Commit-0-0&lt;5ms&gt;, RunTx-0&lt;18ms&gt;, Waiting&lt;3333ms&gt;]. module=main ","receiveTime":"1672126877","packId":"6AEF88BF751EAECB-1CF04B","total":"2","logPath":"/data/logs/okexchaind.log","host":"10.13.1.184","topic":"","time":"2022-12-27 15:41:14","serviceId":"dex-val-06-kr-squares","projectName":"online-chain-hk"}],"total":2,"item":null}}

 

文本处理：

jq .data.rows | jq '.[] | .content' | sed 's/&gt;/>/g' | sed 's/&lt;/</g' | sed 's/<font color=\\"red\\">//g' | sed 's/<\/font>//g' | grep 'Height<16281458>' > 2022-12-27.log

重点1：字体红色的red要两个反斜线。

重点2：增加grep Height，筛掉不符合条件的那一行

 

 

sed：

https://blog.csdn.net/junjieguo/article/details/7525794

jq：

https://wangchujiang.com/linux-command/c/jq.html

https://mozillazg.com/2018/01/jq-use-examples-cookbook.html

https://tallate.github.io/226416.html