Python 基础之列表去重的几种玩法

列表去重

1.方法1 借助一个临时列表

ids = [1,2,3,3,4,2,3,4,5,6,1]
news_ids = []
for id in ids:
    if id not in news_ids:
        news_ids.append(id)
print news_ids

2.方法2 使用set方法进行去重，此方法处理简单但是不会保留之前的顺序

ids = [1,4,3,3,4,2,3,4,5,6,1]
ids = set(ids)

3.方法3 使用匿名函数lambda和reduce函数处理

ids = [1,4,3,3,4,2,3,4,5,6,1]
func = lambda x,y:x if y in x else x + [y]
ids = reduce(func, [[], ] + ids)
print  ids 

4.方法4 使用itertools模块

import itertools
ids = [1,4,3,3,4,2,3,4,5,6,1]
ids.sort()
it = itertools.groupby(ids)
ids_new=[]
for k, g in it:
    ids_new.append(k)
print ids_new

5.使用wihile遍历去重

ids = [1,2,1,1,1,2,3,4,5]
def delRepeat(liebiao):
    for x in liebiao:
        while liebiao.count(x)>1:
            del liebiao[liebiao.index(x)]
    print liebiao
delRepeat(ids)