python去除文件中重复的行

去除文件中重复的行
import os
with open('db.txt','r',encoding='utf-8') as read_f,\
        open('.db.txt.swap','w',encoding='utf-8') as write_f:
    s=set()
    for line in read_f:
        if line not in s:
            s.add(line)
            write_f.write(line)
os.remove('db.txt')
os.rename('.db.txt.swap','db.txt')

 

posted @ 2020-12-19 17:22  梦回少叔坐地而谈  阅读(706)  评论(0编辑  收藏  举报