雕刻时光

just do it……nothing impossible
  博客园  :: 首页  :: 新随笔  :: 联系 :: 订阅 订阅  :: 管理

python 批量请求url

Posted on 2016-02-16 15:10  huhuuu  阅读(2472)  评论(0编辑  收藏  举报
import urllib2
from urllib import quote

f = open("data.in", "r")
out = file("data2.out","w+")
a = 1.0
for line in f:
        #print line     
        stri = quote(line)
        url ='*******'+stri 
        #print url
        try:
                data = urllib2.urlopen(url)
        except:
                date = 'error'
        no = str(a)
        out.writelines(no+'  '+ data.read())

        a = a+ 1
        if (a%1000==0):
                print a
        #print data.read()

f.close()

out.close()