【笔记】Python读取各种编码的csv

Python csv库读取csv文件经常遇到莫名其妙的编码,报错信息如下:

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb1 in position 0: invalid start byte

于是造如下轮子,解析各种编码的csv文件,后续可持续追加各种编码。

如下:

def read_csv(filename):
    encodings = ['gbk','utf-8','utf-8-sig','GB2312','gb18030',]
    for e in encodings:
        data = []
        try:
            with open(filename, encoding=e) as f:
                reader = csv.reader(f)
                header = next(reader)
                # print(header)
                for row in reader:
                    data.append(row)
            print(filename,e)
            return data
        except:

            print(filename,e)

    print(filename,"==================")
    return False

  

posted @ 2020-07-15 16:02  stagebo  阅读(2221)  评论(0编辑  收藏  举报