宁波凌尚网络专业提供宁波SEO、宁波网站优化、宁波网站推广服务

在日志文件中搜索“spider”这个词，或者搜索蜘蛛的IP.然后对应下面的搜素蜘蛛的地址来分析哪些搜素的蜘蛛爬过你的站点.

下面是整理出来的一些搜索蜘蛛的地址

163蜘蛛

1 202.106.186.*
2 202.108.36.*
3 202.108.44.*
4 202.108.45.*
5 202.108.5.*
6 202.108.9.*
7 220.181.12.*
8 220.181.13.*
9 220.181.14.*
10 220.181.15.*
11 220.181.28.*
12 220.181.31.*
13 222.185.245.*

3721蜘蛛

14 202.165.100.*

百度蜘蛛

220.181.38.177
15 220.181.19.*
16 159.226.50.*
17 202.108.11.*
18 202.108.22.*
19 202.108.23.*
20 202.108.249.*
21 202.108.250.*
22 61.135.145.*
23 61.135.146.*

become.com蜘蛛

24 64.124.85.*

china蜘蛛

25 61.151.243.*

gais.cs.ccu.edu.tw蜘蛛

26 202.165.96.*

google蜘蛛

27 216.239.33.*
28 216.239.35.*
29 216.239.37.*
30 216.239.39.*
31 216.239.51.*
32 216.239.53.*
33 216.239.55.*
34 216.239.57.*
35 216.239.59.*
36 64.233.161.*
37 64.233.189.*
38 66.102.11.*
39 66.102.7.*
40 66.102.9.*
41 66.249.64.*
42 66.249.65.*
43 66.249.66.*
44 66.249.71.*
45 66.249.72.*
46 72.14.207.*

iask蜘蛛

47 61.135.152.*

msn蜘蛛

48 65.54.188.*
49 65.54.225.*
50 65.54.226.*
51 65.54.228.*
52 65.54.229.*
53 207.46.98.*
54 207.68.157.*

noxtrumbot蜘蛛

55 194.224.199.*

Outfox蜘蛛

56 220.181.8.*
57 221.239.209.*

psbot蜘蛛

58 217.212.224.*

QQ蜘蛛

59 219.133.40.*
60 202.96.170.*
61 202.104.129.*
62 61.135.157.*

sina蜘蛛

63 219.142.118.*
64 219.142.78.*

sohu蜘蛛

65 61.135.132.*
66 220.181.26.*
220.181.19.*

tom蜘蛛

67 61.135.158.*

yahoo蜘蛛

68 66.196.90.*
69 66.196.91.*
70 68.142.249.*
71 68.142.250.*
72 68.142.251.*
73 202.165.102.* yahoo中国蜘蛛
74 202.160.178.* yahoo中国蜘蛛
75 202.160.179.* yahoo中国蜘蛛
76 202.160.180.* yahoo中国蜘蛛
77 202.160.181.* yahoo中国蜘蛛
78 202.160.183.* yahoo中国蜘蛛
79 72.30.101.*
80 72.30.102.*
81 72.30.103.*
82 72.30.104.*
83 72.30.107.*
84 72.30.110.*
85 72.30.111.*
86 72.30.128.*
87 72.30.129.*
88 72.30.131.*
89 72.30.133.*
90 72.30.134.*
91 72.30.135.*
92 72.30.216.*
93 72.30.226.*
94 72.30.252.*
95 72.30.97.*
96 72.30.98.*
97 72.30.99.*
98 74.6.74.*

中搜蜘蛛

99 202.108.4.*
100 202.108.4.*
101 202.108.33.*
102 202.96.51.*
103 219.142.53.*