python读csv文件的优化
贴代码如下:
- file=open("JData/JData_Action_201602.csv")
- start=time.time()
- for i in range(0,100):
- j=csv.reader(file)
- Time1=time.time()
- Time1=Time1-start
- start=time.time()
- for i in range(0,100):
- j=csv.reader(open("JData/JData_Action_201602.csv"))
- Time2=time.time()
- Time2=Time2-start
- print "Time1:",Time1
- print "Time2:",Time2
贴结果如下:
- lu@lu:~$ python dataCleaner.py
- Time1: 0.000128984451294
- Time2: 0.000988006591797
- lu@lu:~$ python dataCleaner.py
- Time1: 0.000130891799927
- Time2: 0.00102400779724
- lu@lu:~$ python dataCleaner.py
- Time1: 6.29425048828e-05
- Time2: 0.000524044036865
- lu@lu:~$ python dataCleaner.py
- Time1: 0.000155925750732
- Time2: 0.00112199783325
- lu@lu:~$ python dataCleaner.py
- Time1: 6.79492950439e-05
- Time2: 0.000508069992065
总结:
真正耗时的是读文件操作,因此建议先把文件读好,也就是生成Time1的那种方式
浙公网安备 33010602011771号