python调es借口查询数据

from elasticsearch import Elasticsearch
import pymysql
import datetime
from dateutil.relativedelta import relativedelta
beforday = (datetime.date.today() + relativedelta(days=-1)).strftime('%Y.%m.%d')
class Getdata:
        def conn_es(self,index_name,query):
                es_host = ['10.12.0.26','10.12.0.18','10.12.0.19']
                self.index_name = index_name
                self.query = query
                es = Elasticsearch(
                        es_host,
                        sniff_on_start = True,
                        sniff_on_connection_fail = True,
                        sniff_timeout = 60,
                        port = 9200
                )
                page_num = 100
                res = es.search(index= self.index_name, body = self.query, scroll = '5m', size = page_num)
                results = res['hits']['hits']
                total = res['hits']['total']
                scroll_id = res['_scroll_id']
                every_num = int(total/page_num)
                for i in range(0,every_num+1):
                        query_scroll = es.scroll(scroll_id = scroll_id ,scroll = '5m')['hits']['hits']
                        results += query_scroll
                return  results

posted @   fat_girl_spring  阅读(189)  评论(0编辑  收藏  举报
编辑推荐:
· Linux系列:如何用heaptrack跟踪.NET程序的非托管内存泄露
· 开发者必知的日志记录最佳实践
· SQL Server 2025 AI相关能力初探
· Linux系列:如何用 C#调用 C方法造成内存泄露
· AI与.NET技术实操系列(二):开始使用ML.NET
阅读排行:
· 被坑几百块钱后,我竟然真的恢复了删除的微信聊天记录!
· 没有Manus邀请码?试试免邀请码的MGX或者开源的OpenManus吧
· 【自荐】一款简洁、开源的在线白板工具 Drawnix
· 园子的第一款AI主题卫衣上架——"HELLO! HOW CAN I ASSIST YOU TODAY
· Docker 太简单,K8s 太复杂?w7panel 让容器管理更轻松!
点击右上角即可分享
微信分享提示