百度首页 | 百度空间
 
查看文章
 
google删爱批发网之分析googlebot爬行记录
2008/07/21 09:44 P.M.

空间:新一代飓风1型虚拟主机,linux系统,2008年7月17日晚23点开通。

域名:aipifa.net,2008年7月18日注册,并启用。

网站系统:ecshop v.2.6.0,PHP+MYSQL

网站LOG分析:

2008-07-17:无爬虫来过。

2008-07-18:无爬虫来过。

2008-07-19蜘蛛爬行记录

来自google.com的IP为:203.208.60.4、66.249.73.74、203.208.60.4从19/Jul/2008:01:50:25至19/Jul/2008:02:00:42 +0800共爬行过70多个页面

googlebot于19/Jul/2008:01:50:25访问robots.txt,期间将网站全部遍历,并收录目录中,并于19/Jul/2008:02:00:42 结束访问。

googlebot于19/Jul/2008:11:18:51至19/Jul/2008:12:37:04期间再次来访,分别爬过:/feed.php不同参数页面。googlebot于19/Jul/2008:12:54:25至19/Jul/2008:13:41:16再次爬行feed.php文件,googlebot于19/Jul/2008:14:03:16至19/Jul/2008:14:05:20继续爬行feed.php文件,19/Jul/2008:14:22:38再次访问feed.php,19/Jul/2008:14:35:40Googlebot再次访问feed.php文件。

以下为googlebot访问记录(2008-7-19):

66.249.73.74 - - [19/Jul/2008:14:44:53] /article_cat.php?id=1
66.249.73.74 - - [19/Jul/2008:14:58:20] /article_cat.php?id=2
66.249.73.74 - - [19/Jul/2008:15:22:09 +0800] "GET /search.php?pickout=1&category=4
66.249.73.74 - - [19/Jul/2008:15:26:14 +0800] "GET /goods.php?id=19&from=rss HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:15:36:19 +0800] "GET /goods.php?id=18&from=rss HTTP/1.1"
66.249.71.150 - - [19/Jul/2008:19:46:11 +0800] "GET /feed.php?cat=5 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:20:09:44 +0800] "GET /feed.php?cat=4 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:20:18:29 +0800] "GET /goods.php?id=27 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:20:20:14 +0800] "GET /goods.php?id=32 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:20:25:30 +0800] "GET /goods.php?id=31 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:20:34:18 +0800] "GET /goods.php?id=25 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:20:36:03 +0800] "GET /goods.php?id=28 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:20:41:01 +0800] "GET /goods.php?id=21 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:20:46:55 +0800] "GET /goods.php?id=26 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:20:50:19 +0800] "GET /goods.php?id=24 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:20:53:45 +0800] "GET /goods.php?id=29 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:21:05:37 +0800] "GET /goods.php?id=20 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:21:07:19 +0800] "GET /goods.php?id=34 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:21:12:24 +0800] "GET /goods.php?id=23 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:21:29:17 +0800] "GET /feed.php?cat=44 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:21:31:28 +0800] "GET /feed.php?cat=36 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:21:33:39 +0800] "GET /feed.php?cat=32 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:21:35:50 +0800] "GET /feed.php?cat=20 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:21:42:16 +0800] "GET /goods.php?id=22 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:21:43:58 +0800] "GET /feed.php?cat=35 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:21:45:51 +0800] "GET /feed.php?brand=8 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:22:00:59 +0800] "GET /goods.php?id=30 HTTP/1.1"

66.249.73.74 - - [19/Jul/2008:22:08:30 +0800] "GET /feed.php?cat=24 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:22:17:21 +0800] "GET /brand.php?id=8&cat=4 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:22:19:14 +0800] "GET /article_cat.php?id=4 HTTP/1.1"

66.249.73.74 - - [19/Jul/2008:22:30:39 +0800] "GET /pick_out.php?cat_id=8 HTTP/1.1"

203.208.60.4 - - [19/Jul/2008:22:38:15 +0800] "GET /category.php?id=6&brand=8 HTTP/1.1"

66.249.73.74 - - [19/Jul/2008:22:41:45 +0800] "GET /category.php?id=7&brand=8 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:22:46:19 +0800] "GET /category.php?id=4&brand=8 HTTP/1.1"

66.249.73.74 - - [19/Jul/2008:23:03:17 +0800] "GET /article_cat.php?id=1&page=1 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:23:06:21 +0800] "GET /article_cat.php?id=2&page=1 HTTP/1.1"
66.249.73.74 - - [19/Jul/2008:23:07:54 +0800] "GET /category.php?id=8&brand=8 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:23:09:27 +0800] "GET /category.php?id=9&brand=8 HTTP/1.1"
203.208.60.4 - - [19/Jul/2008:23:23:25 +0800] "GET /category.php?id=46 HTTP/1.1"

以下为googlebot访问记录(2008-7-20):

66.249.73.74 - - [20/Jul/2008:04:03:44 +0800] "GET /goods.php?id=31&from=rss HTTP/1.1"
203.208.60.4 - - [20/Jul/2008:04:10:05 +0800] "GET /goods.php?id=29&from=rss HTTP/1.1"
66.249.73.74 - - [20/Jul/2008:04:20:03 +0800] "GET /goods.php?id=20&from=rss HTTP/1.1"
66.249.73.74 - - [20/Jul/2008:04:34:34 +0800] "GET /goods.php?id=21&from=rss HTTP/1.1"
66.249.73.74 - - [20/Jul/2008:04:36:23 +0800] "GET /goods.php?id=24&from=rss HTTP/1.1"
66.249.73.74 - - [20/Jul/2008:05:00:10 +0800] "GET /article_cat.php?id=4&page=1 HTTP/1.1"

尚未发现问题~~~~


类别:默认分类 | 添加到搜藏 | 浏览() | 评论 (0)
 
最近读者:
 
网友评论:
发表评论:
姓 名:
网址或邮箱: (选填)
内 容:
验证码:
 

     

©2008 Baidu