监控进程导致mysql实例无法连接

结论:

LOCK_global_system_variablesLOCK_logLOCK_status 这三把锁被三个不同线程各自持有一把,然后等另外一把,形成环路死锁。已经分析的三个不同实例原因一致。

 

问题来源:

同事接报多个实例连接无响应,但数据库进程仍在,机器状态正常,同机器上的其它实例也正常,error日志中无异常,考虑到要恢复用户业务,当前僵死实例对定位问题提供帮助不多,故打印堆栈之后重启实例恢复。

 

分析:

第一个实例堆栈文件中线程非常多,有1000多个,分析相对麻烦,选了第二个只有600多线程的问题实例堆栈信息分析,下载对应版本代码(percona 5.7.24_7版本)。

结合源码,分析加放锁逻辑,发现 线程 600、线程 577、线程 572有问题,线程600持有LOCK_log等LOCK_status,线程572持有LOCK_status等 LOCK_global_system_variables,线程577持有 LOCK_global_system_variables等LOCK_log, 三个线程互等互锁,形成死锁。

 

对应的堆栈文件:

pstack_133295.log

 

 

线程600详细信息

线程600在 MYSQL_BIN_LOG::ordered_commit 函数中加LOCK_log 然而在 MYSQL_BIN_LOG::publish_coordinates_for_global_status函数中等 LOCK_status,

线程600堆栈信息如下:

Thread 600 (Thread 0x7f2f0d50c700 (LWP 133394)):
#0  0x0000003e9380e334 in __lll_lock_wait () from /lib64/libpthread.so.0
#1  0x0000003e9380960e in _L_lock_995 () from /lib64/libpthread.so.0
#2  0x0000003e93809576 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3  0x0000000000e73698 in MYSQL_BIN_LOG::publish_coordinates_for_global_status() const ()
#4  0x0000000000e79f5e in MYSQL_BIN_LOG::ordered_commit(THD*, bool, bool) ()
#5  0x0000000000e7d3e2 in MYSQL_BIN_LOG::commit(THD*, bool) ()
#6  0x00000000007a8db1 in ha_commit_trans(THD*, bool, bool) ()
#7  0x0000000000cf1259 in trans_commit(THD*) ()
#8  0x0000000000e4705b in Xid_log_event::do_commit(THD*) ()
#9  0x0000000000e471ce in Xid_apply_log_event::do_apply_event_worker(Slave_worker*) ()
#10 0x0000000000eb519f in slave_worker_exec_job_group(Slave_worker*, Relay_log_info*) ()
#11 0x0000000000e9829b in handle_slave_worker ()
#12 0x0000000000ef6d34 in pfs_spawn_thread ()
#13 0x0000003e93807aa1 in start_thread () from /lib64/libpthread.so.0
#14 0x0000003e934e8aad in clone () from /lib64/libc.so.6

对应的代码如下:

 

 

mysql_mutex_assert_owner(&LOCK_log); 是检查此时必须是当前线程持有LOCK_log才可以继续,说明已经持有LOCK_Log锁,然后下面尝试加LOCK_status锁,此时进入等待。

 

线程577详细信息

线程577 在 show_status_array 函数加了LOCK_global_system_variables锁,然后进get_one_variable函数最后到PolyLock_lock_log::rdlock等LOCK_log锁。

线程577堆栈信息如下:

Thread 577 (Thread 0x7f2db1d3c700 (LWP 57037)):
#0  0x0000003e9380e334 in __lll_lock_wait () from /lib64/libpthread.so.0
#1  0x0000003e938095d8 in _L_lock_854 () from /lib64/libpthread.so.0
#2  0x0000003e938094a7 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3  0x0000000000cd5a8f in PolyLock_lock_log::rdlock() ()
#4  0x0000000000bb81b5 in sys_var::value_ptr(THD*, THD*, enum_var_type, st_mysql_lex_string*) ()
#5  0x0000000000c9233c in get_one_variable_ext(THD*, THD*, st_mysql_show_var const*, enum_var_type, enum_mysql_show_type, system_status_var*, charset_info_st const**, char*, unsigned long*) ()
#6  0x0000000000c923a1 in get_one_variable(THD*, st_mysql_show_var const*, enum_var_type, enum_mysql_show_type, system_status_var*, charset_info_st const**, char*, unsigned long*) ()
#7  0x0000000000c9778c in show_status_array(THD*, char const*, st_mysql_show_var*, enum_var_type, system_status_var*, char const*, TABLE_LIST*, bool, Item*) ()
#8  0x0000000000c9d286 in fill_variables(THD*, TABLE_LIST*, Item*) ()
#9  0x0000000000c8ab3c in do_fill_table(THD*, TABLE_LIST*, QEP_TAB*) ()
#10 0x0000000000c9da3c in get_schema_tables_result(JOIN*, enum_schema_table_state) ()
#11 0x0000000000c8089d in JOIN::prepare_result() ()
#12 0x0000000000c11ca0 in JOIN::exec() ()
#13 0x0000000000c811ed in handle_query(THD*, LEX*, Query_result*, unsigned long long, unsigned long long) ()
#14 0x0000000000765c0a in execute_sqlcom_select(THD*, TABLE_LIST*) ()
#15 0x0000000000c444c4 in mysql_execute_command(THD*, bool) ()
#16 0x0000000000c478a5 in mysql_parse(THD*, Parser_state*, bool) ()
#17 0x0000000000c484a7 in dispatch_command(THD*, COM_DATA const*, enum_server_command) ()
#18 0x0000000000c49f07 in do_command(THD*) ()
#19 0x0000000000d079e0 in handle_connection ()
#20 0x0000000000ef6d34 in pfs_spawn_thread ()
#21 0x0000003e93807aa1 in start_thread () from /lib64/libpthread.so.0
#22 0x0000003e934e8aad in clone () from /lib64/libc.so.6

对应位置代码,show_status_array 函数持有LOCK_global_system_variables锁部分。

 

 

PolyLock_lock_log::rdlock部分代码:

 

 

最后尝试加LOCK_log锁进入等待。

 

线程572详细信息

线程572在 fill_status 中持有了 LOCK_status 最后在等show_status_array函数中等 LOCK_global_system_variables锁。

线程572堆栈信息如下:

Thread 572 (Thread 0x7f2ce95be700 (LWP 57042)):
#0  0x0000003e9380e334 in __lll_lock_wait () from /lib64/libpthread.so.0
#1  0x0000003e9380960e in _L_lock_995 () from /lib64/libpthread.so.0
#2  0x0000003e93809576 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3  0x0000000000c9772b in show_status_array(THD*, char const*, st_mysql_show_var*, enum_var_type, system_status_var*, char const*, TABLE_LIST*, bool, Item*) ()
#4  0x0000000000c9ebb0 in fill_status(THD*, TABLE_LIST*, Item*) ()
#5  0x0000000000c8ab3c in do_fill_table(THD*, TABLE_LIST*, QEP_TAB*) ()
#6  0x0000000000c9da3c in get_schema_tables_result(JOIN*, enum_schema_table_state) ()
#7  0x0000000000c8089d in JOIN::prepare_result() ()
#8  0x0000000000c11ca0 in JOIN::exec() ()
#9  0x0000000000c811ed in handle_query(THD*, LEX*, Query_result*, unsigned long long, unsigned long long) ()
#10 0x0000000000765c0a in execute_sqlcom_select(THD*, TABLE_LIST*) ()
#11 0x0000000000c41d22 in mysql_execute_command(THD*, bool) ()
#12 0x0000000000c478a5 in mysql_parse(THD*, Parser_state*, bool) ()
#13 0x0000000000c484a7 in dispatch_command(THD*, COM_DATA const*, enum_server_command) ()
#14 0x0000000000c49f07 in do_command(THD*) ()
#15 0x0000000000d079e0 in handle_connection ()
#16 0x0000000000ef6d34 in pfs_spawn_thread ()
#17 0x0000003e93807aa1 in start_thread () from /lib64/libpthread.so.0
#18 0x0000003e934e8aad in clone () from /lib64/libc.so.6

fill_status中对应的代码:

 

 

这里要注意的是加 LOCK_status之前的判断,if (thd->fill_status_recursion_level++ == 0) 

这是防止多次加锁,但至少会加一次,官方对应的注释如下:

  /**
    Used by fill_status() to avoid acquiring LOCK_status mutex twice
    when this function is called recursively (e.g. queries
    that contains SELECT on I_S.GLOBAL_STATUS with subquery on the
    same I_S table).
    Incremented each time fill_status() function is entered and
    decremented each time before it returns from the function.
  */

 

在show_status_array中最后等LOCK_global_system_variables锁相关代码:

 

 

正在进行的业务分析:

线程572在show global status, 线程577在show global variables,线程600是并行回放的sql线条正在apply binlog,处于提交状态,结合另外两个有问题的实例情况看,都是在进行show global status和 show global variables,但有一个是主库,正在进行正常事务提交,因此只要在show 参数和status时做 MYSQL_BIN_LOG::ordered_commit就可能触发,并不一定要是从库回放线程在aplly binlog才触发。

为什么新开连接在死等:

在等 LOCK_global_system_variables 锁,新开连接必须持有该锁。

堆栈信息如下:

Thread 2 (Thread 0x7f2a50609700 (LWP 139711)):
#0  0x0000003e9380e334 in __lll_lock_wait () from /lib64/libpthread.so.0
#1  0x0000003e9380960e in _L_lock_995 () from /lib64/libpthread.so.0
#2  0x0000003e93809576 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3  0x0000000000c00888 in THD::init() ()
#4  0x0000000000c0398f in THD::THD(bool) ()
#5  0x0000000000e34a6a in Channel_info::create_thd() ()
#6  0x0000000000d0acbe in Channel_info_tcpip_socket::create_thd() ()
#7  0x0000000000d078af in handle_connection ()
#8  0x0000000000ef6d34 in pfs_spawn_thread ()
#9  0x0000003e93807aa1 in start_thread () from /lib64/libpthread.so.0
#10 0x0000003e934e8aad in clone () from /lib64/libc.so.6

THD::init()代码如下:

 

 

所有会有大量的连接处于等该锁状态。

 

如何避免该问题
  1. 升级到5.7.31和8.0.21之后版本。

观察最新版本代码发现版本中已经去掉了PolyLock_lock_log::rdlock,搜索官方个修复记录,官方已经在5.7.31和8.0.21彻底修复了该问题: https://bugs.mysql.com/bug.php?id=91941

  1. 排查最近业务变更,是否加大了show global status 和 show global variables的频繁,从代码逻辑上看,减少这两个操作能降低bug命中率。

 

mysql> show processlist;
+------+----------+----------------------+------------------+------------------+------+---------------------------------------------------------------+------------------------------------------------------------------------------------------------------+-----------+---------------+
| Id | User | Host | db | Command | Time | State | Info | Rows_sent | Rows_examined |
+------+----------+----------------------+------------------+------------------+------+---------------------------------------------------------------+------------------------------------------------------------------------------------------------------+-----------+---------------+
| 6 | program | 10.144.44.135:54932 | summer_marketing | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 14 | program | 10.144.150.149:54890 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 22 | program | 10.144.2.193:49096 | summer_sale | Query | 46 | executing | select @@session.transaction_read_only | 0 | 0 |
| 23 | program | 10.144.73.177:58426 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 27 | program | 10.144.169.192:48944 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 55 | program | 10.145.82.224:59830 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 58 | program | 10.144.44.135:54936 | summer_marketing | Query | 25 | executing | select @@session.transaction_read_only | 0 | 0 |
| 60 | program | 10.144.176.99:42110 | summer_sale | Query | 78 | executing | select @@session.transaction_read_only | 0 | 0 |
| 65 | program | 10.144.150.149:54894 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 67 | program | 10.144.219.83:50014 | open_operation | Query | 106 | executing | select @@session.transaction_read_only | 0 | 0 |
| 77 | program | 10.144.169.192:48948 | summer_sale | Sleep | 114 | | NULL | 1 | 61 |
| 78 | program | 10.144.219.83:50020 | open_operation | Query | 60 | executing | select @@session.transaction_read_only | 0 | 0 |
| 84 | program | 10.144.98.196:47666 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 88 | program | 10.144.98.196:47672 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 91 | program | 10.144.98.196:47676 | summer_sync | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 93 | program | 10.144.219.83:50022 | open_operation | Query | 76 | executing | select @@session.transaction_read_only | 0 | 0 |
| 95 | program | 10.144.129.156:56694 | summer_marketing | Query | 79 | executing | select @@session.transaction_read_only | 0 | 0 |
| 109 | program | 10.144.73.177:58436 | summer_marketing | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 110 | program | 10.144.150.149:54898 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 114 | program | 10.144.98.197:34602 | summer_sync | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 115 | program | 10.144.193.198:51428 | open_operation | Query | 77 | executing | select @@session.transaction_read_only | 0 | 0 |
| 116 | program | 10.145.73.228:50810 | summer_marketing | Query | 105 | executing | select @@session.transaction_read_only | 0 | 0 |
| 117 | program | 10.144.129.156:56696 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 125 | program | 10.144.2.193:49100 | summer_sale | Query | 58 | executing | select @@session.transaction_read_only | 0 | 0 |
| 126 | program | 10.144.98.197:34610 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 127 | program | 10.144.98.197:34622 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 128 | program | 10.144.98.197:34612 | summer_sync | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 132 | program | 10.144.98.197:34628 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 133 | program | 10.144.98.197:34626 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 134 | program | 10.144.98.197:34624 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 136 | program | 10.144.98.197:34630 | summer_sync | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 143 | program | 10.144.98.197:34636 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 145 | program | 10.144.9.148:38716 | summer_marketing | Query | 55 | executing | select @@session.transaction_read_only | 0 | 0 |
| 147 | program | 10.144.2.194:39032 | summer_sale | Sleep | 116 | | NULL | 1 | 4 |
| 154 | program | 10.144.44.135:54952 | summer_marketing | Query | 31 | executing | select @@session.transaction_read_only | 0 | 0 |
| 165 | program | 10.144.73.177:58450 | summer_marketing | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 166 | program | 10.144.16.31:41466 | summer_marketing | Sleep | 235 | | NULL | 1 | 0 |
| 167 | program | 10.144.150.149:54910 | summer_marketing | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 172 | program | 10.145.73.135:51308 | summer_marketing | Query | 95 | executing | select @@session.transaction_read_only | 0 | 0 |
| 173 | program | 10.144.2.194:39040 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 175 | program | 10.145.82.224:59860 | summer_sync | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 180 | program | 10.144.9.148:38726 | summer_marketing | Query | 17 | executing | select @@session.transaction_read_only | 0 | 0 |
| 185 | program | 10.144.213.244:34112 | summer_marketing | Query | 37 | executing | select @@session.transaction_read_only | 0 | 0 |
| 186 | program | 10.144.16.31:41472 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 189 | program | 10.144.150.149:54916 | summer_marketing | Query | 70 | executing | select @@session.transaction_read_only | 0 | 0 |
| 201 | program | 10.144.73.177:58460 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 203 | program | 10.144.169.192:48968 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 208 | program | 10.144.150.149:54926 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 212 | program | 10.145.205.119:53170 | summer_progress | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 213 | program | 10.144.44.135:54976 | summer_marketing | Query | 22 | executing | select @@session.transaction_read_only | 0 | 0 |
| 215 | program | 10.144.193.198:51432 | open_operation | Query | 108 | executing | select @@session.transaction_read_only | 0 | 0 |
| 216 | program | 10.144.2.194:39050 | summer_sale | Query | 101 | executing | select @@session.transaction_read_only | 0 | 0 |
| 221 | program | 10.144.150.149:54928 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 227 | program | 10.144.9.148:38740 | summer_marketing | Query | 5 | executing | select @@session.transaction_read_only | 0 | 0 |
| 232 | program | 10.145.73.135:51326 | summer_marketing | Query | 77 | executing | select @@session.transaction_read_only | 0 | 0 |
| 233 | program | 10.144.73.177:58468 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 243 | program | 10.144.129.156:56738 | summer_marketing | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 245 | program | 10.144.176.99:42138 | summer_sale | Query | 66 | executing | select @@session.transaction_read_only | 0 | 0 |
| 248 | program | 10.144.9.148:38748 | summer_marketing | Query | 49 | executing | select @@session.transaction_read_only | 0 | 0 |
| 249 | program | 10.144.73.177:58480 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 250 | program | 10.144.150.149:54938 | summer_marketing | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 267 | program | 10.144.16.31:41494 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 271 | program | 10.144.73.177:58486 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 282 | program | 10.145.73.228:50860 | summer_marketing | Query | 74 | executing | select @@session.transaction_read_only | 0 | 0 |
| 284 | program | 10.144.140.231:33694 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 288 | program | 10.145.73.135:51340 | summer_marketing | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 289 | program | 10.144.176.99:42154 | summer_sale | Query | 90 | executing | select @@session.transaction_read_only | 0 | 0 |
| 294 | program | 10.144.44.135:55000 | summer_marketing | Query | 67 | executing | select @@session.transaction_read_only | 0 | 0 |
| 296 | program | 10.144.169.192:48986 | summer_sale | Sleep | 117 | | NULL | 1 | 3 |
| 301 | program | 10.144.150.149:54950 | summer_marketing | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 302 | program | 10.144.140.231:33696 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 303 | program | 10.144.177.84:59158 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 311 | program | 10.144.73.177:58500 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 312 | program | 10.144.2.193:49152 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 320 | program | 10.145.73.135:51346 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 329 | program | 10.144.2.194:39082 | summer_sale | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 335 | program | 10.144.177.84:59162 | summer_sale | Query | 107 | executing | select @@session.transaction_read_only | 0 | 0 |
| 336 | program | 10.144.140.231:33698 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 339 | program | 10.144.129.156:56766 | summer_marketing | Query | 69 | executing | select @@session.transaction_read_only | 0 | 0 |
| 345 | program | 10.144.44.135:55018 | summer_marketing | Query | 105 | executing | select @@session.transaction_read_only | 0 | 0 |
| 346 | program | 10.145.73.135:51350 | summer_marketing | Query | 77 | executing | select @@session.transaction_read_only | 0 | 0 |
| 348 | program | 10.145.73.228:50870 | summer_marketing | Query | 101 | executing | select @@session.transaction_read_only | 0 | 0 |
| 354 | program | 10.144.130.179:58242 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 355 | program | 10.144.177.84:59164 | summer_sale | Query | 101 | executing | select @@session.transaction_read_only | 0 | 0 |
| 356 | program | 10.144.150.149:54962 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 359 | program | 10.144.9.148:38776 | summer_marketing | Query | 8 | executing | select @@session.transaction_read_only | 0 | 0 |
| 367 | program | 10.144.213.244:34212 | summer_marketing | Query | 96 | executing | select @@session.transaction_read_only | 0 | 0 |
| 369 | program | 10.144.177.83:47924 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 370 | program | 10.144.44.135:55024 | summer_marketing | Query | 106 | executing | select @@session.transaction_read_only | 0 | 0 |
| 373 | program | 10.144.16.31:41512 | summer_marketing | Query | 2 | executing | select @@session.transaction_read_only | 0 | 0 |
| 374 | program | 10.144.140.231:33702 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 378 | program | 10.144.9.148:38782 | summer_marketing | Query | 28 | executing | select @@session.transaction_read_only | 0 | 0 |
| 386 | program | 10.144.2.194:39100 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 387 | program | 10.145.73.228:50888 | summer_marketing | Query | 87 | executing | select @@session.transaction_read_only | 0 | 0 |
| 391 | program | 10.144.140.231:33704 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 392 | program | 10.144.129.156:56778 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 394 | program | 10.144.177.84:59168 | summer_sale | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 396 | program | 10.144.2.193:49176 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 400 | program | 10.145.73.135:51360 | summer_marketing | Query | 79 | executing | select @@session.transaction_read_only | 0 | 0 |
| 405 | program | 10.144.177.83:47928 | summer_sale | Query | 104 | executing | select @@session.transaction_read_only | 0 | 0 |
| 412 | program | 10.144.9.148:38794 | summer_marketing | Query | 23 | executing | select @@session.transaction_read_only | 0 | 0 |
| 414 | program | 10.144.140.231:33708 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 415 | program | 10.144.177.84:59170 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 423 | program | 10.144.177.83:47932 | summer_sale | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 445 | program | 10.144.2.193:49188 | summer_sale | Query | 62 | executing | select @@session.transaction_read_only | 0 | 0 |
| 449 | program | 10.144.73.177:58522 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 454 | program | 10.144.44.135:55048 | summer_marketing | Query | 19 | executing | select @@session.transaction_read_only | 0 | 0 |
| 457 | program | 10.144.177.83:47936 | summer_sale | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 458 | program | 10.144.2.194:39120 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 462 | program | 10.144.177.84:59172 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 464 | program | 10.144.130.179:58264 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 466 | program | 10.144.150.149:54980 | summer_marketing | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 476 | program | 10.144.129.156:56794 | summer_marketing | Query | 69 | executing | select @@session.transaction_read_only | 0 | 0 |
| 477 | program | 10.144.150.149:54984 | summer_marketing | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 478 | program | 10.144.73.177:58524 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 488 | program | 10.144.177.83:47940 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 495 | program | 10.144.177.84:59174 | summer_sale | Query | 108 | executing | select @@session.transaction_read_only | 0 | 0 |
| 496 | program | 10.144.130.179:58270 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 498 | program | 10.144.129.156:56800 | summer_marketing | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 502 | program | 10.144.2.193:49198 | summer_sale | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 515 | program | 10.144.73.177:58532 | summer_marketing | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 521 | program | 10.144.129.156:56804 | summer_marketing | Query | 88 | executing | select @@session.transaction_read_only | 0 | 0 |
| 523 | program | 10.144.177.83:47944 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 525 | program | 10.144.130.179:58280 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 541 | program | 10.144.44.135:55068 | summer_marketing | Query | 20 | executing | select @@session.transaction_read_only | 0 | 0 |
| 544 | program | 10.144.129.156:56812 | summer_marketing | Query | 70 | executing | select @@session.transaction_read_only | 0 | 0 |
| 545 | program | 10.145.205.119:53198 | summer_progress | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 548 | program | 10.144.2.194:39138 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 554 | program | 10.144.73.177:58540 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 556 | program | 10.145.205.117:42692 | summer_progress | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 571 | program | 10.145.73.135:51416 | summer_marketing | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 574 | program | 10.144.73.177:58546 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 579 | program | 10.144.130.179:58308 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 584 | program | 10.144.2.193:49222 | summer_sale | Sleep | 112 | | NULL | 1 | 19 |
| 589 | program | 10.145.73.135:51424 | summer_marketing | Query | 104 | executing | select @@session.transaction_read_only | 0 | 0 |
| 590 | program | 10.144.9.148:38838 | summer_marketing | Query | 4 | executing | select @@session.transaction_read_only | 0 | 0 |
| 596 | program | 10.144.73.177:58552 | summer_marketing | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 600 | program | 10.144.169.192:49044 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 609 | program | 10.144.193.198:51456 | open_operation | Query | 103 | executing | select @@session.transaction_read_only | 0 | 0 |
| 614 | program | 10.144.44.135:55090 | summer_marketing | Query | 105 | executing | select @@session.transaction_read_only | 0 | 0 |
| 617 | program | 10.144.44.135:55092 | summer_marketing | Query | 102 | executing | select @@session.transaction_read_only | 0 | 0 |
| 625 | program | 10.145.73.228:50948 | summer_marketing | Query | 85 | executing | select @@session.transaction_read_only | 0 | 0 |
| 632 | program | 10.144.9.148:38858 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 634 | program | 10.144.193.198:51460 | open_operation | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 637 | program | 10.144.44.135:55098 | summer_marketing | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 643 | program | 10.145.73.135:51440 | summer_marketing | Query | 70 | executing | select @@session.transaction_read_only | 0 | 0 |
| 651 | program | 10.145.73.228:50954 | summer_marketing | Query | 54 | executing | select @@session.transaction_read_only | 0 | 0 |
| 658 | program | 10.145.73.135:51450 | summer_marketing | Query | 77 | executing | select @@session.transaction_read_only | 0 | 0 |
| 662 | program | 10.144.140.230:42124 | summer_marketing | Query | 94 | executing | select @@session.transaction_read_only | 0 | 0 |
| 676 | program | 10.144.2.193:49248 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 681 | program | 10.145.73.135:51458 | summer_marketing | Query | 74 | executing | select @@session.transaction_read_only | 0 | 0 |
| 701 | program | 10.145.73.135:51462 | summer_marketing | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 703 | program | 10.144.193.198:51464 | open_operation | Query | 65 | executing | select @@session.transaction_read_only | 0 | 0 |
| 707 | program | 10.144.199.56:60482 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 708 | program | 10.144.2.193:49256 | summer_sale | Query | 74 | executing | select @@session.transaction_read_only | 0 | 0 |
| 712 | program | 10.145.205.117:42752 | summer_progress | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 724 | program | 10.144.169.192:49062 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 732 | program | 10.145.82.224:60022 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 741 | program | 10.144.176.99:42260 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 750 | program | 10.144.2.194:39190 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 754 | program | 10.144.176.99:42264 | summer_sale | Sleep | 115 | | NULL | 1 | 10 |
| 761 | program | 10.144.176.99:42266 | summer_sale | Sleep | 108 | | NULL | 1 | 47 |
| 766 | program | 10.145.205.118:47664 | summer_progress | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 769 | program | 10.144.176.99:42270 | summer_sale | Sleep | 112 | | NULL | 1 | 47 |
| 770 | program | 10.144.2.194:39194 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 775 | program | 10.145.205.118:47666 | summer_progress | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 777 | program | 10.144.169.192:49080 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 789 | program | 10.144.176.99:42274 | summer_sale | Sleep | 110 | | NULL | 1 | 13 |
| 800 | program | 10.144.140.230:42162 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 804 | program | 10.144.169.192:49086 | summer_sale | Sleep | 110 | | NULL | 1 | 4 |
| 815 | program | 10.144.2.194:39208 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 839 | program | 10.144.2.193:49304 | summer_sale | Sleep | 116 | | NULL | 1 | 11 |
| 844 | program | 10.144.176.99:42298 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 852 | program | 10.144.140.230:42196 | summer_marketing | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 865 | program | 10.144.169.192:49106 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 875 | program | 10.144.2.194:39230 | summer_sale | Sleep | 115 | | NULL | 1 | 10 |
| 886 | program | 10.144.2.194:39234 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 896 | program | 10.144.2.194:39236 | summer_sale | Sleep | 116 | | NULL | 1 | 11 |
| 900 | program | 10.144.199.56:60530 | summer_sale | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 912 | program | 10.144.2.193:49330 | summer_sale | Query | 58 | executing | select @@session.transaction_read_only | 0 | 0 |
| 917 | program | 10.144.140.230:42226 | summer_marketing | Query | 93 | executing | select @@session.transaction_read_only | 0 | 0 |
| 927 | program | 10.144.176.99:42348 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 929 | program | 10.144.2.193:49334 | summer_sale | Query | 99 | executing | select @@session.transaction_read_only | 0 | 0 |
| 937 | program | 10.144.176.99:42360 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 943 | program | 10.144.2.193:49338 | summer_sale | Query | 52 | executing | select @@session.transaction_read_only | 0 | 0 |
| 947 | program | 10.145.205.120:56324 | summer_progress | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 956 | program | 10.144.140.230:42258 | summer_marketing | Query | 93 | executing | select @@session.transaction_read_only | 0 | 0 |
| 964 | program | 10.144.140.230:42262 | summer_marketing | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 968 | program | 10.144.169.192:49286 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 970 | program | 10.144.2.193:49346 | summer_sale | Sleep | 113 | | NULL | 1 | 4 |
| 1009 | program | 10.144.176.99:42402 | summer_sale | Query | 66 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1025 | program | 10.144.2.194:39290 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1028 | program | 10.144.176.99:42414 | summer_sale | Sleep | 117 | | NULL | 0 | 1 |
| 1030 | program | 10.144.2.193:49376 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1049 | program | 10.144.2.194:39300 | summer_sale | Sleep | 115 | | NULL | 1 | 10 |
| 1052 | program | 10.145.66.89:51396 | summer_sale | Query | 105 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1054 | program | 10.144.130.231:43242 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1065 | program | 10.144.169.192:49340 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1085 | program | 10.144.169.192:49344 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1107 | program | 10.144.130.231:43258 | summer_sale | Sleep | 117 | | NULL | 0 | 0 |
| 1119 | program | 10.145.66.89:51412 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1135 | program | 10.144.2.193:49406 | summer_sale | Query | 62 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1136 | program | 10.144.2.194:39330 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 1140 | program | 10.144.169.192:49372 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1150 | program | 10.144.2.193:49414 | summer_sale | Query | 101 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1172 | program | 10.144.169.192:49388 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1196 | program | 10.145.66.89:51428 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1210 | program | 10.144.169.192:49406 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1231 | program | 10.144.28.49:42562 | summer_sale | Query | 88 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1260 | program | 10.144.202.131:45394 | summer_sale | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1300 | program | 10.144.199.56:60708 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1310 | program | 10.144.28.49:42596 | summer_sale | Query | 94 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1315 | program | 10.144.28.49:42598 | summer_sale | Query | 101 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1433 | program | 10.145.66.89:51578 | summer_sale | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1458 | program | 10.145.66.89:51598 | summer_sale | Query | 105 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1464 | program | 10.144.130.231:43550 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1493 | program | 10.144.28.49:42740 | summer_sale | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1511 | program | 10.144.202.131:45540 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1570 | program | 10.144.28.49:42828 | summer_sale | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1579 | program | 10.144.202.131:45686 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1710 | program | 10.144.28.49:43058 | summer_sale | Query | 93 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1718 | program | 10.145.73.226:48930 | summer_sale | Sleep | 110 | | NULL | 0 | 0 |
| 1721 | program | 10.145.73.226:48932 | summer_sale | Query | 104 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1731 | program | 10.145.73.226:48936 | summer_sale | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1734 | program | 10.144.199.56:32826 | summer_sale | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1736 | program | 10.145.73.226:48938 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1738 | program | 10.144.202.131:45800 | summer_sale | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1763 | program | 10.144.199.56:32878 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1780 | program | 10.144.202.131:45836 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1802 | program | 10.144.199.56:32948 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1922 | program | 10.145.82.224:34006 | summer_sync | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1926 | program | 10.145.82.224:34024 | summer_sync | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1932 | program | 10.144.98.196:47746 | summer_sync | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1936 | program | 10.144.127.210:41200 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1938 | program | 10.144.127.210:41370 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1939 | program | 10.144.127.210:41466 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1941 | program | 10.144.127.210:41542 | summer_sale | Query | 101 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1942 | program | 10.144.127.210:41570 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1951 | program | 10.144.173.75:37970 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1954 | program | 10.144.173.75:37978 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1955 | program | 10.144.173.75:37980 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1956 | program | 10.144.173.75:37982 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1957 | program | 10.144.173.75:37984 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1966 | program | 10.144.150.155:43712 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1971 | program | 10.144.150.155:43722 | summer_sale | Query | 108 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1975 | program | 10.144.47.15:43734 | summer_sale | Sleep | 146 | | NULL | 0 | 0 |
| 1981 | program | 10.144.177.85:37760 | summer_sale | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1982 | program | 10.144.177.85:37762 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1984 | program | 10.144.177.85:37768 | summer_sale | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1985 | program | 10.144.177.85:37770 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 1987 | program | 10.144.177.85:37774 | summer_sale | Sleep | 111 | | NULL | 0 | 0 |
| 1998 | program | 10.144.16.31:43896 | summer_marketing | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2009 | program | 10.144.16.31:43940 | summer_marketing | Query | 101 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2030 | program | 10.144.73.178:59932 | summer_sale | Sleep | 212 | | NULL | 0 | 0 |
| 2031 | program | 10.144.150.155:37646 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2046 | program | 10.145.205.121:57466 | summer_sale | Sleep | 280 | | NULL | 0 | 0 |
| 2062 | program | 10.144.16.32:44180 | summer_sale | Sleep | 189 | | NULL | 0 | 0 |
| 2184 | view | 172.16.43.71:57295 | summer_marketing | Sleep | 227 | | NULL | 57 | 57 |
| 2209 | program | 10.145.73.226:38310 | summer_sale | Query | 108 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2256 | view | 172.16.43.71:63129 | open_operation | Sleep | 1110 | | NULL | 0 | 0 |
| 2265 | program | 10.144.98.197:52786 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2267 | program | 10.144.98.197:52790 | summer_sync | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2269 | program | 10.144.98.197:52794 | summer_sync | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2271 | slave | 10.32.32.12:37705 | NULL | Binlog Dump GTID | 1292 | Master has sent all binlog to slave; waiting for more updates | NULL | 0 | 0 |
| 2272 | program | 10.144.98.197:52798 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2277 | view | 172.16.43.71:63139 | open_operation | Sleep | 1110 | | NULL | 0 | 0 |
| 2283 | program | 10.144.130.231:38228 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2285 | program | 10.144.130.231:38232 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2286 | program | 10.144.130.231:38236 | summer_sale | Sleep | 117 | | NULL | 0 | 0 |
| 2289 | program | 10.144.150.155:60308 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2290 | program | 10.144.150.155:60312 | summer_sale | Sleep | 116 | | NULL | 1 | 252926 |
| 2291 | program | 10.145.205.120:42472 | summer_progress | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2315 | program | 10.145.82.224:52342 | summer_sync | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2316 | program | 10.145.82.224:52360 | summer_sync | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2317 | program | 10.145.82.224:52474 | summer_sync | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2318 | program | 10.145.82.224:52494 | summer_sync | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2322 | program | 10.144.213.244:59730 | summer_marketing | Query | 56 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2324 | program | 10.144.127.210:57826 | summer_sale | Query | 103 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2339 | program | 10.144.169.192:38304 | summer_sale | Sleep | 115 | | NULL | 1 | 234 |
| 2340 | program | 10.144.169.192:38306 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 2341 | program | 10.144.169.192:38324 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2342 | program | 10.144.169.192:38332 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2343 | program | 10.144.2.193:38768 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2344 | program | 10.144.2.193:38770 | summer_sale | Sleep | 114 | | NULL | 1 | 3 |
| 2345 | program | 10.144.2.194:42038 | summer_sale | Query | 85 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2346 | program | 10.144.2.194:42042 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 2347 | program | 10.144.169.192:38338 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2348 | program | 10.144.2.194:42048 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2349 | program | 10.144.2.194:42050 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2350 | program | 10.144.2.194:42052 | summer_sale | Sleep | 118 | | NULL | 1 | 4 |
| 2352 | program | 10.144.2.193:38818 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2353 | program | 10.144.213.244:47904 | summer_marketing | Query | 52 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2354 | program | 10.144.213.244:47912 | summer_marketing | Query | 70 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2364 | program | 10.144.213.244:47962 | summer_marketing | Query | 46 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2366 | program | 10.144.213.244:47970 | summer_marketing | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2368 | program | 10.145.73.135:54606 | summer_marketing | Query | 75 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2369 | program | 10.144.213.244:47974 | summer_marketing | Query | 84 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2370 | program | 10.144.213.244:47976 | summer_marketing | Query | 62 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2371 | program | 10.145.73.135:54610 | summer_marketing | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2373 | program | 10.144.213.244:47988 | summer_marketing | Query | 49 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2374 | program | 10.144.213.244:47992 | summer_marketing | Query | 56 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2375 | program | 10.145.73.135:54616 | summer_marketing | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2378 | program | 10.144.176.99:58210 | summer_sale | Sleep | 113 | | NULL | 1 | 3 |
| 2379 | program | 10.144.176.99:58218 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2380 | program | 10.144.176.99:58220 | summer_sale | Query | 87 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2381 | program | 10.144.176.99:58222 | summer_sale | Sleep | 110 | | NULL | 1 | 13 |
| 2382 | program | 10.144.176.99:58226 | summer_sale | Query | 97 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2383 | program | 10.144.176.99:58230 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2384 | program | 10.144.176.99:58234 | summer_sale | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2386 | program | 10.144.150.149:33508 | summer_marketing | Query | 99 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2387 | program | 10.144.150.149:33510 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2388 | program | 10.144.176.99:58276 | summer_sale | Sleep | 111 | | NULL | 1 | 7 |
| 2391 | program | 10.144.150.149:33700 | summer_marketing | Query | 90 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2392 | view | 172.16.43.71:63237 | open_auth2 | Sleep | 791 | | NULL | 2 | 32 |
| 2393 | view | 172.16.43.71:63240 | summer_sale | Sleep | 185 | | NULL | 0 | 0 |
| 2399 | program | 10.145.73.228:52758 | summer_marketing | Query | 55 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2401 | program | 10.145.73.228:52770 | summer_marketing | Query | 95 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2402 | program | 10.145.73.228:52772 | summer_marketing | Query | 28 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2403 | program | 10.145.73.228:52774 | summer_marketing | Query | 53 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2404 | program | 10.145.73.228:52776 | summer_marketing | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2405 | program | 10.145.73.228:52780 | summer_marketing | Query | 74 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2415 | program | 10.144.16.31:48160 | summer_marketing | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2416 | program | 10.144.16.31:48162 | summer_marketing | Query | 61 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2417 | program | 10.144.16.31:48164 | summer_marketing | Query | 9 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2418 | program | 10.144.16.31:48168 | summer_marketing | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2419 | program | 10.144.16.31:48170 | summer_marketing | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2420 | program | 10.144.16.31:48172 | summer_marketing | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2421 | program | 10.144.16.31:48176 | summer_marketing | Query | 56 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2422 | program | 10.144.16.31:48182 | summer_marketing | Query | 105 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2423 | program | 10.144.2.193:40464 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2443 | program | 10.144.140.230:36240 | summer_marketing | Query | 99 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2444 | program | 10.144.140.230:36246 | summer_marketing | Query | 97 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2445 | program | 10.144.9.148:40014 | summer_marketing | Query | 65 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2446 | program | 10.144.9.148:40016 | summer_marketing | Query | 102 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2447 | program | 10.144.140.230:36258 | summer_marketing | Query | 97 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2448 | program | 10.144.140.230:36260 | summer_marketing | Query | 94 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2450 | program | 10.144.140.230:36264 | summer_marketing | Query | 104 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2451 | program | 10.144.140.230:36266 | summer_marketing | Query | 92 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2452 | program | 10.144.9.148:40022 | summer_marketing | Query | 20 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2455 | program | 10.144.9.148:40026 | summer_marketing | Query | 22 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2456 | program | 10.144.140.230:36276 | summer_marketing | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2457 | program | 10.144.140.230:36278 | summer_marketing | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2461 | program | 10.144.140.230:36288 | summer_marketing | Query | 92 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2463 | program | 10.144.9.148:40032 | summer_marketing | Query | 40 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2464 | program | 10.144.129.156:44584 | summer_marketing | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2465 | program | 10.144.130.179:46128 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2466 | program | 10.144.130.179:46222 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2476 | program | 10.145.66.89:35584 | summer_sale | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2486 | program | 10.144.44.135:53864 | summer_marketing | Query | 42 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2487 | program | 10.144.44.135:53866 | summer_marketing | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2488 | program | 10.144.73.177:54728 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2489 | program | 10.144.73.177:54752 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2490 | program | 10.144.73.177:54756 | summer_marketing | Query | 108 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2491 | program | 10.144.173.75:43406 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2493 | program | 10.144.98.196:34402 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2495 | program | 10.144.98.196:34404 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2499 | program | 10.144.98.196:34408 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2500 | program | 10.144.98.196:34410 | summer_sync | Query | 86 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2505 | program | 10.144.219.83:44848 | open_operation | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2512 | program | 10.144.193.198:37658 | open_operation | Query | 87 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2513 | program | 10.144.98.196:34418 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2515 | program | 10.145.82.224:49128 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2518 | program | 10.144.219.83:44854 | open_operation | Query | 108 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2520 | program | 10.145.82.224:49132 | summer_sync | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2522 | program | 10.144.98.196:34422 | summer_sync | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2526 | program | 10.144.98.196:34424 | summer_sync | Sleep | 237 | | NULL | 1 | 1 |
| 2527 | program | 10.144.193.198:37672 | open_operation | Query | 66 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2532 | program | 10.144.98.196:34430 | summer_sync | Sleep | 237 | | NULL | 0 | 0 |
| 2534 | program | 10.145.82.224:49138 | summer_sync | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2553 | program | 10.144.2.193:45026 | summer_sale | Sleep | 118 | | NULL | 1 | 3 |
| 2554 | program | 10.144.2.193:45032 | summer_sale | Query | 83 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2573 | program | 10.144.169.192:48680 | summer_sale | Sleep | 110 | | NULL | 1 | 4 |
| 2574 | program | 10.144.169.192:48686 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2575 | program | 10.144.169.192:48692 | summer_sale | Sleep | 110 | | NULL | 1 | 169 |
| 2607 | program | 10.144.199.56:55288 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2608 | program | 10.144.199.56:55292 | summer_sale | Sleep | 110 | | NULL | 0 | 0 |
| 2637 | view | 172.16.43.71:59864 | summer_sale | Sleep | 185 | | NULL | 35 | 35 |
| 2646 | program | 10.144.73.178:50260 | summer_marketing | Sleep | 259 | | NULL | 102 | 102 |
| 2661 | program | 10.145.205.121:41170 | summer_marketing | Sleep | 570 | | NULL | 156 | 156 |
| 2671 | program | 10.145.73.135:42470 | summer_marketing | Query | 72 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2672 | program | 10.144.127.210:44664 | summer_sale | Query | 105 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2673 | program | 10.145.73.135:42472 | summer_marketing | Query | 79 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2674 | program | 10.144.177.84:54736 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2675 | program | 10.144.176.99:38900 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 2676 | program | 10.144.176.99:38912 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2677 | program | 10.144.176.99:38914 | summer_sale | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2678 | program | 10.144.176.99:38916 | summer_sale | Sleep | 62 | | NULL | 0 | 0 |
| 2681 | program | 10.144.2.193:53006 | summer_sale | Query | 92 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2683 | program | 10.144.150.149:54292 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2684 | program | 10.144.150.149:54302 | summer_marketing | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2685 | program | 10.144.150.149:54304 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2686 | program | 10.144.150.149:54306 | summer_marketing | Query | 93 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2687 | program | 10.144.150.149:54308 | summer_marketing | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2688 | program | 10.144.150.149:54310 | summer_marketing | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2689 | program | 10.144.150.149:54312 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2690 | program | 10.144.150.149:54314 | summer_marketing | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2691 | program | 10.144.150.149:54316 | summer_marketing | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2692 | program | 10.144.2.194:55830 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 2693 | program | 10.144.2.194:55836 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2696 | program | 10.144.177.83:35034 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2697 | program | 10.144.2.194:56086 | summer_sale | Query | 79 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2698 | program | 10.144.177.83:35076 | summer_sale | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2699 | program | 10.144.177.83:35078 | summer_sale | Query | 109 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2704 | program | 10.144.16.31:39104 | summer_marketing | Query | 18 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2705 | program | 10.144.16.31:39110 | summer_marketing | Query | 4 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2706 | program | 10.144.16.31:39112 | summer_marketing | Query | 5 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2707 | program | 10.144.150.149:55262 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2708 | program | 10.144.150.149:55268 | summer_marketing | Query | 110 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2709 | program | 10.144.150.149:55270 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2710 | program | 10.144.150.149:55272 | summer_marketing | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2711 | program | 10.144.150.149:55274 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2712 | program | 10.144.44.135:47544 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2713 | program | 10.144.44.135:47546 | summer_marketing | Query | 21 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2722 | program | 10.144.177.85:53456 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2724 | program | 10.145.73.228:33902 | summer_marketing | Query | 39 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2725 | program | 10.145.73.228:33906 | summer_marketing | Query | 65 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2726 | program | 10.144.177.85:53510 | summer_sale | Query | 102 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2727 | program | 10.144.140.231:46794 | summer_sale | Sleep | 118 | | NULL | 0 | 0 |
| 2746 | program | 10.144.44.135:51776 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2747 | program | 10.144.44.135:51790 | summer_marketing | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2748 | program | 10.144.44.135:51792 | summer_marketing | Query | 28 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2749 | program | 10.144.44.135:51794 | summer_marketing | Query | 32 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2750 | program | 10.144.177.85:54866 | summer_sale | Sleep | 107 | | NULL | 0 | 0 |
| 2755 | view | 172.16.43.71:64001 | summer_sync | Sleep | 380 | | NULL | 2 | 29865823 |
| 2756 | view | 172.16.43.71:64002 | summer_sync | Sleep | 409 | | NULL | 5 | 5 |
| 2767 | root | localhost | NULL | Query | 0 | starting | show processlist | 0 | 0 |
| 2771 | program | 10.145.127.125:56650 | open_auth2 | Sleep | 1 | | NULL | 1 | 1 |
| 2773 | program | 10.145.127.124:38714 | open_auth2 | Sleep | 0 | | NULL | 1 | 1 |
| 2774 | program | 10.144.205.230:55988 | open_auth2 | Sleep | 0 | | NULL | 1 | 1 |
| 2775 | program | 10.144.205.230:55992 | open_auth2 | Sleep | 364 | | NULL | 1 | 0 |
| 2776 | program | 10.144.127.208:54718 | open_auth2 | Sleep | 1 | | NULL | 1 | 1 |
| 2777 | program | 10.145.127.124:38720 | open_auth2 | Sleep | 14 | | NULL | 1 | 1 |
| 2778 | program | 10.145.127.125:56786 | open_auth2 | Sleep | 363 | | NULL | 1 | 0 |
| 2779 | program | 10.145.196.159:40684 | open_auth2 | Sleep | 0 | | NULL | 1 | 1 |
| 2781 | program | 10.144.199.56:54678 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2782 | program | 10.144.199.56:54680 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2783 | program | 10.144.199.56:54682 | summer_sale | Sleep | 118 | | NULL | 0 | 0 |
| 2784 | program | 10.144.199.56:54684 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2785 | program | 10.144.199.56:54686 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2786 | program | 10.144.199.56:54688 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2787 | program | 10.144.199.56:54690 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2788 | program | 10.144.199.56:54692 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2789 | program | 10.144.199.56:54694 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2790 | program | 10.144.129.156:45662 | summer_marketing | Query | 75 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2791 | program | 10.145.73.228:46480 | summer_marketing | Query | 86 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2792 | program | 10.145.73.228:46482 | summer_marketing | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2793 | program | 10.145.73.228:46484 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2794 | program | 10.145.73.228:46486 | summer_marketing | Query | 30 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2795 | program | 10.145.73.228:46490 | summer_marketing | Query | 60 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2796 | program | 10.144.129.156:45790 | summer_marketing | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2797 | program | 10.145.73.228:46492 | summer_marketing | Query | 34 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2798 | program | 10.144.129.156:46066 | summer_marketing | Query | 75 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2799 | program | 10.144.129.156:46068 | summer_marketing | Query | 72 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2800 | program | 10.144.129.156:46070 | summer_marketing | Query | 71 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2801 | program | 10.144.129.156:46072 | summer_marketing | Query | 103 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2802 | program | 10.144.129.156:46074 | summer_marketing | Query | 73 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2803 | program | 10.144.129.156:46112 | summer_marketing | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2804 | program | 10.144.127.208:55322 | open_auth2 | Sleep | 361 | | NULL | 1 | 0 |
| 2805 | program | 10.144.129.156:46258 | summer_marketing | Query | 82 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2806 | program | 10.145.73.228:46496 | summer_marketing | Query | 65 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2807 | program | 10.144.129.156:46276 | summer_marketing | Query | 104 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2808 | program | 10.144.129.156:46282 | summer_marketing | Query | 82 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2809 | program | 10.145.73.228:46498 | summer_marketing | Query | 58 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2810 | program | 10.145.73.228:46500 | summer_marketing | Query | 29 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2811 | program | 10.145.73.228:46502 | summer_marketing | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2812 | program | 10.145.73.228:46504 | summer_marketing | Query | 27 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2813 | program | 10.144.127.208:55426 | open_auth2 | Sleep | 360 | | NULL | 1 | 0 |
| 2814 | program | 10.144.202.131:54204 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2815 | program | 10.144.202.131:54206 | summer_sale | Sleep | 109 | | NULL | 0 | 0 |
| 2816 | program | 10.144.129.156:46498 | summer_marketing | Query | 86 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2817 | program | 10.145.73.228:46516 | summer_marketing | Query | 26 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2818 | program | 10.144.129.156:46506 | summer_marketing | Query | 74 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2819 | program | 10.145.73.228:46520 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2820 | program | 10.144.98.197:37266 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2821 | program | 10.144.98.197:37268 | summer_sync | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2822 | program | 10.144.98.197:37270 | summer_sync | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2823 | program | 10.144.98.197:37272 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2824 | program | 10.144.98.197:37274 | summer_sync | Sleep | 358 | | NULL | 0 | 0 |
| 2825 | program | 10.144.98.197:37276 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2826 | program | 10.145.82.224:55622 | summer_sync | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2827 | program | 10.144.98.197:37278 | summer_sync | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2828 | program | 10.145.82.224:55624 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2829 | program | 10.144.98.197:37280 | summer_sync | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2830 | program | 10.145.82.224:55626 | summer_sync | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2831 | program | 10.145.82.224:55628 | summer_sync | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2832 | program | 10.145.82.224:55632 | summer_sync | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2833 | program | 10.145.82.224:55634 | summer_sync | Query | 118 | query end | INSERT INTO sync_order_history ( sync_order_id,
push_system_id,
register_id,
register_code,
registe | 0 | 0 |
| 2834 | program | 10.145.82.224:55636 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2835 | program | 10.144.98.196:39122 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2836 | program | 10.144.98.196:39124 | summer_sync | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2837 | program | 10.144.193.198:60872 | open_operation | Query | 62 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2838 | program | 10.144.98.196:39126 | summer_sync | Sleep | 237 | | NULL | 1 | 0 |
| 2839 | program | 10.144.193.198:60874 | open_operation | Query | 76 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2840 | program | 10.144.98.196:39128 | summer_sync | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2841 | program | 10.144.193.198:60878 | open_operation | Query | 59 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2842 | program | 10.144.98.196:39132 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2843 | program | 10.144.193.198:60880 | open_operation | Query | 57 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2844 | program | 10.144.98.196:39134 | summer_sync | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2845 | program | 10.144.193.198:60884 | open_operation | Query | 89 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2848 | program | 10.145.127.125:56986 | open_auth2 | Sleep | 358 | | NULL | 1 | 0 |
| 2849 | program | 10.144.177.83:39794 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2850 | program | 10.144.177.83:39796 | summer_sale | Query | 103 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2851 | program | 10.145.82.224:55720 | summer_sync | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2852 | program | 10.144.205.230:56012 | open_auth2 | Sleep | 357 | | NULL | 1 | 0 |
| 2854 | program | 10.145.196.159:40930 | open_auth2 | Sleep | 356 | | NULL | 1 | 0 |
| 2855 | program | 10.145.127.125:57062 | open_auth2 | Sleep | 356 | | NULL | 1 | 0 |
| 2856 | program | 10.144.127.208:55986 | open_auth2 | Sleep | 356 | | NULL | 1 | 0 |
| 2858 | program | 10.144.205.230:56024 | open_auth2 | Sleep | 355 | | NULL | 1 | 0 |
| 2859 | program | 10.145.196.159:40978 | open_auth2 | Sleep | 355 | | NULL | 1 | 0 |
| 2860 | program | 10.144.127.208:56090 | open_auth2 | Sleep | 353 | | NULL | 1 | 0 |
| 2861 | program | 10.145.127.125:57170 | open_auth2 | Sleep | 353 | | NULL | 1 | 0 |
| 2863 | program | 10.144.127.208:56106 | open_auth2 | Sleep | 350 | | NULL | 1 | 0 |
| 2864 | program | 10.144.127.208:56108 | open_auth2 | Sleep | 349 | | NULL | 1 | 0 |
| 2865 | program | 10.144.127.208:56110 | open_auth2 | Sleep | 349 | | NULL | 1 | 0 |
| 2866 | program | 10.144.127.208:56112 | open_auth2 | Sleep | 349 | | NULL | 1 | 0 |
| 2867 | program | 10.144.127.208:56114 | open_auth2 | Sleep | 349 | | NULL | 1 | 0 |
| 2868 | program | 10.145.127.124:38780 | open_auth2 | Sleep | 349 | | NULL | 1 | 0 |
| 2869 | program | 10.145.196.159:41230 | open_auth2 | Sleep | 347 | | NULL | 1 | 0 |
| 2870 | program | 10.145.127.124:38786 | open_auth2 | Sleep | 347 | | NULL | 1 | 0 |
| 2871 | program | 10.144.205.230:56556 | open_auth2 | Sleep | 347 | | NULL | 1 | 0 |
| 2872 | program | 10.145.196.159:41272 | open_auth2 | Sleep | 346 | | NULL | 1 | 0 |
| 2873 | program | 10.145.127.124:38794 | open_auth2 | Sleep | 345 | | NULL | 1 | 0 |
| 2874 | program | 10.145.196.159:41308 | open_auth2 | Sleep | 345 | | NULL | 1 | 0 |
| 2875 | program | 10.145.127.125:57462 | open_auth2 | Sleep | 344 | | NULL | 1 | 0 |
| 2878 | program | 10.145.127.125:57578 | open_auth2 | Sleep | 343 | | NULL | 1 | 0 |
| 2880 | program | 10.145.127.124:38806 | open_auth2 | Sleep | 341 | | NULL | 1 | 0 |
| 2881 | program | 10.145.196.159:41482 | open_auth2 | Sleep | 341 | | NULL | 1 | 0 |
| 2882 | program | 10.145.196.159:41484 | open_auth2 | Sleep | 341 | | NULL | 1 | 0 |
| 2883 | program | 10.145.196.159:41486 | open_auth2 | Sleep | 341 | | NULL | 1 | 0 |
| 2884 | program | 10.145.196.159:41490 | open_auth2 | Sleep | 341 | | NULL | 1 | 0 |
| 2885 | program | 10.144.205.230:56620 | open_auth2 | Sleep | 340 | | NULL | 1 | 0 |
| 2886 | program | 10.145.127.125:57728 | open_auth2 | Sleep | 338 | | NULL | 1 | 0 |
| 2887 | program | 10.145.127.125:57736 | open_auth2 | Sleep | 338 | | NULL | 1 | 0 |
| 2888 | program | 10.145.127.125:57738 | open_auth2 | Sleep | 338 | | NULL | 1 | 0 |
| 2890 | program | 10.145.127.124:38834 | open_auth2 | Sleep | 336 | | NULL | 1 | 0 |
| 2891 | program | 10.144.205.230:56644 | open_auth2 | Sleep | 335 | | NULL | 1 | 0 |
| 2892 | program | 10.144.205.230:56658 | open_auth2 | Sleep | 333 | | NULL | 1 | 0 |
| 2893 | program | 10.144.205.230:56660 | open_auth2 | Sleep | 332 | | NULL | 1 | 0 |
| 2894 | program | 10.144.205.230:56662 | open_auth2 | Sleep | 332 | | NULL | 1 | 0 |
| 2895 | program | 10.145.127.124:38862 | open_auth2 | Sleep | 330 | | NULL | 1 | 0 |
| 2896 | program | 10.145.127.124:38866 | open_auth2 | Sleep | 329 | | NULL | 1 | 0 |
| 2897 | program | 10.145.127.124:38868 | open_auth2 | Sleep | 329 | | NULL | 1 | 0 |
| 2916 | program | 10.144.173.75:34930 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2917 | program | 10.144.173.75:34950 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2921 | program | 10.144.173.75:35298 | summer_sale | Sleep | 118 | | NULL | 0 | 0 |
| 2924 | program | 10.144.173.75:35622 | summer_sale | Sleep | 116 | | NULL | 0 | 0 |
| 2925 | program | 10.144.173.75:35624 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2926 | program | 10.144.150.155:37026 | summer_sale | Query | 106 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2932 | program | 10.145.66.89:35278 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2933 | program | 10.144.127.210:48978 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2934 | program | 10.144.213.244:51300 | summer_marketing | Query | 68 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2935 | program | 10.145.66.89:35296 | summer_sale | Sleep | 118 | | NULL | 0 | 0 |
| 2936 | program | 10.144.213.244:51302 | summer_marketing | Query | 68 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2937 | program | 10.144.127.210:48988 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2938 | program | 10.144.213.244:51306 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2939 | program | 10.144.127.210:48990 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2940 | program | 10.144.213.244:51310 | summer_marketing | Query | 11 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2941 | program | 10.144.169.192:42870 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2942 | program | 10.144.28.49:49864 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2943 | program | 10.144.127.210:49008 | summer_sale | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2944 | program | 10.145.66.89:35298 | summer_sale | Query | 106 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2945 | program | 10.144.213.244:51492 | summer_marketing | Sleep | 237 | | NULL | 1 | 0 |
| 2946 | program | 10.144.169.192:42874 | summer_sale | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2947 | program | 10.144.213.244:51564 | summer_marketing | Query | 38 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2948 | program | 10.144.213.244:51700 | summer_marketing | Query | 107 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2949 | program | 10.144.28.49:49894 | summer_sale | Query | 114 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2950 | program | 10.144.28.49:49900 | summer_sale | Sleep | 99 | | NULL | 1 | 45 |
| 2951 | program | 10.144.28.49:49914 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2952 | program | 10.144.169.192:42894 | summer_sale | Query | 112 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2953 | program | 10.144.28.49:49916 | summer_sale | Query | 101 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2954 | program | 10.144.98.196:39990 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2955 | program | 10.144.169.192:42900 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2956 | program | 10.144.169.192:42902 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 2957 | program | 10.144.28.49:49920 | summer_sale | Query | 94 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2958 | program | 10.144.98.196:39992 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2959 | program | 10.144.213.244:52396 | summer_marketing | Query | 111 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2960 | program | 10.144.98.196:39994 | summer_sync | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2961 | program | 10.144.2.193:57360 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 2962 | program | 10.144.169.192:42904 | summer_sale | Sleep | 116 | | NULL | 1 | 5 |
| 2963 | program | 10.144.98.196:39998 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2964 | program | 10.144.98.196:40000 | summer_sync | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2965 | program | 10.144.2.193:57364 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2966 | program | 10.144.169.192:42906 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2967 | program | 10.144.2.193:57366 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 2968 | program | 10.144.98.196:40002 | summer_sync | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2969 | program | 10.144.127.210:49060 | summer_sale | Sleep | 102 | | NULL | 0 | 0 |
| 2970 | program | 10.144.169.192:42908 | summer_sale | Query | 115 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2971 | program | 10.144.28.49:49956 | summer_sale | Query | 116 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2972 | program | 10.144.169.192:42912 | summer_sale | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2975 | program | 10.144.28.49:49972 | summer_sale | Query | 107 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2976 | program | 10.144.28.49:49976 | summer_sale | Query | 118 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2977 | program | 10.144.169.192:42922 | summer_sale | Sleep | 112 | | NULL | 1 | 29 |
| 2978 | program | 10.144.2.193:57384 | summer_sale | Query | 45 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2979 | program | 10.144.127.210:49084 | summer_sale | Query | 100 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2980 | program | 10.144.127.210:49086 | summer_sale | Sleep | 104 | | NULL | 0 | 0 |
| 2981 | program | 10.144.169.192:42924 | summer_sale | Sleep | 114 | | NULL | 1 | 13 |
| 2982 | program | 10.144.73.177:41412 | summer_marketing | Query | 108 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2983 | program | 10.144.2.193:57396 | summer_sale | Query | 57 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2984 | program | 10.144.2.193:57398 | summer_sale | Query | 57 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2985 | program | 10.144.2.194:59408 | summer_sale | Query | 108 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2986 | program | 10.144.28.49:49988 | summer_sale | Query | 88 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2987 | program | 10.144.73.177:41426 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2988 | program | 10.145.66.89:35418 | summer_sale | Sleep | 104 | | NULL | 0 | 0 |
| 2989 | program | 10.144.16.31:48040 | summer_marketing | Query | 117 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2990 | program | 10.144.16.31:48042 | summer_marketing | Query | 107 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2992 | program | 10.144.73.177:41678 | summer_marketing | Query | 113 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2994 | program | 10.144.219.83:41168 | open_operation | Query | 87 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2995 | program | 10.144.219.83:41170 | open_operation | Query | 94 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2996 | program | 10.144.219.83:41172 | open_operation | Query | 62 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2997 | program | 10.144.219.83:41174 | open_operation | Query | 66 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2998 | program | 10.144.219.83:41176 | open_operation | Query | 87 | executing | select @@session.transaction_read_only | 0 | 0 |
| 2999 | program | 10.144.219.83:41180 | open_operation | Query | 65 | executing | select @@session.transaction_read_only | 0 | 0 |
| 3000 | program | 10.144.219.83:41182 | open_operation | Query | 66 | executing | select @@session.transaction_read_only | 0 | 0 |
| 3033 | telegraf | 10.32.32.10:52163 | NULL | Query | 118 | executing | SHOW GLOBAL STATUS | 0 | 0 |
| 3034 | telegraf | 10.32.32.10:52164 | NULL | Query | 118 | executing | SHOW GLOBAL VARIABLES | 0 | 0 |
+------+----------+----------------------+------------------+------------------+------+---------------------------------------------------------------+------------------------------------------------------------------------------------------------------+-----------+---------------+
615 rows in set (0.00 sec)

 

  1. 再次补充一个关键原因,show_compatibility_56 参数决定bug是否会触发。

show_compatibility_56 为on会触发

show_compatibility_56 为off则不会触发,默认值 为off,但我们线上均为on。

 

在本地构造场景复现bug发现一直复现不了,完全一样的用例。当本地执行 show global variables 和 show global status时,并不会持有LOCK_status LOCK_global_system_variables ,仔细想想似乎也是对的,就是展示一些内存变量,没有必要执行这两个锁,比方说status状态值,有些一直在变的,show出来看到值和当前真实的值不一样是正常的,没必要持有锁。

由于没有头绪,继续按堆栈分析源码,后来发现 show_compatibility_56 参数决定做show 动作时是否会持有锁,这是为了兼容老版本用法的参数。这个参数打开时,show 动作不是直接挨个show出所有参数变量,而是把参数变量先生成内存shcema table,对应 information_schema.GLOBAL_STATUS 和 information_schema.GLOBAL_VARIABLES, 内存中表保存对应的variables和status,这种情况就要持有对应的锁,防止被修改,生成内存表的好处就是方便做过滤筛选出所要的字段,比方说监控工具往往只要几个到几十个关键字段,先构造一个内存表的方式更加方便,可能因为这原因打开了这个参数。

打开show_compatibility_56 之后,本地可以复现稳定卡死复现bug,外在表现和堆栈和线上问题完全一致,采用昨天使用的修复方案反复模拟确认不会触发问题,修复方案是有效的,可以规避这个问题,后续我最好还是将内核升级到高版本,在内核层面解决,一劳永逸。

 

 

posted @ 2021-08-11 16:16  HunterHuang  阅读(304)  评论(0编辑  收藏  举报