5

4

search.yahoo.com

1

1

google.com

52
28
12
9
9
9
8
8
7
7
7
7
7
6
6
6
6
6
6
6

/tips/advice/
/tips/cms_stat.html
/tips/business/news_2007-07-04-01-56-43-272.html
/tips/internet/page_1.html
/tips/ecommerce/page_1.html
/tips/cms_rss.html
/tips/online-promotion/page_1.html
/tips/advice/news_2006-12-18-03-21-54-796.html
/tips/business/page_1.html
/tips/cms_connect.html
/tips/advice/news_2007-07-04-05-22-04-333.html
/tips/computers/page_1.html
/tips/motivational/page_1.html
/tips/emarketing/page_1.html
/tips/finance/page_1.html
/tips/home-business/
/tips/business/news_2007-07-04-01-57-43-329.html
/tips/home-business/page_1.html
/tips/advice/news_2007-07-04-01-57-34-549.html
/tips/advice/news_2007-07-04-01-57-41-689.html

422
148
92
38
28
10
7
5
5
5
3
2
2
2
2
2
1
1
1
1

Yahoo! Slurp; - camouflated as Mozilla/5.0 
bot/1.0 - camouflated as Mozilla/5.0 
Googlebot/2.1 - camouflated as Mozilla/5.0 
Mozilla/5.0 
Mozilla/4.0 
Twiceler - camouflated as Mozilla/5.0 
CCBot/1.0 
bot/1.0 - camouflated as Mozilla/4.0 
Speedy Spider 
Java/1.6.0_04
Mediapartners-Google
Java/1.6.0-oem
Java/1.4.1_04
Java/1.6.0_07
Java/1.6.0_06
Java/1.6.0_03
Java/1.6.0_02
Java/1.6.0_10
Exabot - camouflated as Mozilla/5.0 
naver - camouflated as Yeti/1.0 

30
1

Mozilla/5.0 
Python-urllib/1.17