收集几个爬网程序

A Simple Crawler Using C# Sockets
http://www.codeproject.com/cs/internet/Crawler.asp

Populating a Search Engine with a C# Spider
http://www.codeproject.com/aspnet/Spideroo.asp

A Web Spider Library in C#
http://www.codeproject.com/useritems/ZetaWebSpider.asp