批量更新mysql表数据

1、批量更新表中某个字段,如果表比较大,每条记录都执行一条update,1s执行10条数据,10万条数据就要1W秒,3个多小时。

2、可以用case when 来实现,模板如下

UPDATE categories SET 
display_order = CASE id 
        WHEN 1 THEN 3 
        WHEN 2 THEN 4 
        WHEN 3 THEN 5 
END
WHERE id IN (1,2,3);

ID 是条件字段,WHEN 相当于where,THEN 表示要更新的字段设置成的值。

如果有多个字段要更新,模板如下

UPDATE categories 
    SET dingdan = CASE id 
        WHEN 1 THEN 3 
        WHEN 2 THEN 4 
        WHEN 3 THEN 5 
    END, 
    title = CASE id 
        WHEN 1 THEN 'New Title 1'
        WHEN 2 THEN 'New Title 2'
        WHEN 3 THEN 'New Title 3'
    END
WHERE id IN (1,2,3)

 

手动串接字符太麻烦,可以用python,每串接2000条,执行一次sql,1分钟内解决问题:

sql = " SELECT `id`,c_id,SUM(`total_price` - `reduction`) AS price FROM `orders` WHERE STATUS IN (9,11) AND total_price >0 GROUP BY c_id  HAVING price > 0 ORDER BY c_id"
datas = bt.getData(sql)

error = 0
count = 0
totalcount = 0
id = []
sql = "UPDATE customer SET consumption_amount = consumption_amount + CASE id "
sqlwhen = ""
sqlend = "END WHERE id in "
sqllen = 2000

with open("sqlupdatenew.sql",'w') as f:
    print(len(datas))
    for data in datas:
        if count <= sqllen:
            sqlwhen += "WHEN " + str(data[1]) + " THEN " + str(data[2]) + " "
            count += 1
            id.append(data[1])

        if count == sqllen or totalcount == len(datas) -1:
            mysql = sql + sqlwhen + sqlend + str(tuple(id))
            bt.executesql(mysql)
            temp = sql + sqlwhen + sqlend + str(tuple(id)) + ";\n"
            f.write(temp)
            print(totalcount)
            count = 0
            sqlwhen = ""
            id.clear()

        totalcount += 1


bt.closemysql()

 

posted @ 2018-10-26 17:27  千米屠苏  阅读(3223)  评论(0编辑  收藏  举报