|
Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
2943
|
14.13 %
|
|
|
MacOS
|
1792
|
8.60 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
|
1374
|
6.59 %
|
|
|
Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
|
1051
|
5.04 %
|
|
|
WindowsXP
|
996
|
4.78 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
|
954
|
4.58 %
|
|
|
Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)
|
836
|
4.01 %
|
|
|
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
|
795
|
3.82 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
|
785
|
3.77 %
|
|
|
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
777
|
3.73 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
|
764
|
3.67 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http://www.semrush.com/bot.html)
|
434
|
2.08 %
|
|
|
WindowsNT
|
400
|
1.92 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)
|
381
|
1.83 %
|
|
|
User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; MarkAgent FreeBSD 2.2.8-RELEASE i386; Nav)
|
377
|
1.81 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)
|
325
|
1.56 %
|
|
|
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
310
|
1.49 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html)
|
307
|
1.47 %
|
|
|
Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
|
236
|
1.13 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
|
214
|
1.03 %
|
|
|
ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)
|
201
|
0.96 %
|
|
|
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
|
180
|
0.86 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
|
174
|
0.84 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)
|
170
|
0.82 %
|
|
|
Mozilla/5.0 (compatible; Ezooms/1.0; help@moz.com)
|
169
|
0.81 %
|
|
|
Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
|
159
|
0.76 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://www.semrush.com/bot.html)
|
151
|
0.72 %
|
|
|
Linux
|
128
|
0.61 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
|
126
|
0.60 %
|
|
|
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)
|
123
|
0.59 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
|
123
|
0.59 %
|
|
|
Windows2000
|
92
|
0.44 %
|
|
|
findlinks/2.0.2 (+http://wortschatz.uni-leipzig.de/findlinks/)
|
89
|
0.43 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1.1~bl; +http://www.semrush.com/bot.html)
|
85
|
0.41 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
|
82
|
0.39 %
|
|
|
|
79
|
0.38 %
|
|
|
DoCoMo2.1; +http:
|
77
|
0.37 %
|
|
|
findlinks/2.6 (+http://wortschatz.uni-leipzig.de/findlinks/)
|
73
|
0.35 %
|
|
|
Windows98
|
72
|
0.35 %
|
|
|
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
|
67
|
0.32 %
|
|
|
msnbot/2.0b (+http://search.msn.com/msnbot.htm)._
|
66
|
0.32 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)
|
65
|
0.31 %
|
|
|
Java/1.6.0_04
|
58
|
0.28 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1~bl; +http://www.semrush.com/bot.html)
|
55
|
0.26 %
|
|
|
鏤�Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
47
|
0.23 %
|
|
|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
43
|
0.21 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/3.1; +http://ahrefs.com/robot/)
|
39
|
0.19 %
|
|
|
Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)
|
38
|
0.18 %
|
|
|
DoCoMomobile goo; +http:
|
37
|
0.18 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/3.0; +http://ahrefs.com/robot/)
|
36
|
0.17 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://mj12bot.com/)
|
36
|
0.17 %
|
|
|
Mozilla/4.0+(compatible;+Robot/1.0)
|
36
|
0.17 %
|
|
|
CCBot/2.0 (https://commoncrawl.org/faq/)
|
35
|
0.17 %
|
|
|
Y!J-BRW/1.0 crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
|
35
|
0.17 %
|
|
|
Windows95
|
32
|
0.15 %
|
|
|
CCBot/2.0 (http://commoncrawl.org/faq/)
|
32
|
0.15 %
|
|
|
Wotbox/2.01 (+http://www.wotbox.com/bot/)
|
31
|
0.15 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/0.98~bl; +http://www.semrush.com/bot.html)
|
29
|
0.14 %
|
|
|
BUbiNG (+http://law.di.unimi.it/BUbiNG.html#wc)
|
29
|
0.14 %
|
|
|
Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
|
27
|
0.13 %
|
|
|
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
|
27
|
0.13 %
|
|
|
ltx71 - (http://ltx71.com/)
|
27
|
0.13 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.4; http://www.majestic12.co.uk/bot.php?+)
|
27
|
0.13 %
|
|
|
Y!J-ASR/0.1 crawler (http://www.yahoo-help.jp/app/answers/detail/p/595/a_id/42716/)
|
26
|
0.12 %
|
|
|
HatenaBookmark/4.0 (Hatena::Bookmark; Analyzer)
|
24
|
0.12 %
|
|
|
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/1alpha.jp)
|
23
|
0.11 %
|
|
|
Mozilla/5.0 (compatible; Adsbot/3.1)
|
23
|
0.11 %
|
|
|
Tobot/Nutch-1.4 ('tobot at eel dot rdc dot toshiba dot co dot jp')
|
22
|
0.11 %
|
|
|
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze)
|
21
|
0.10 %
|
|
|
MauiBot (crawler.feedback+wc@gmail.com)
|
21
|
0.10 %
|
|
|
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
|
20
|
0.10 %
|
|
|
TsolCrawler/Nutch-1.4 (http://www.toshiba-sol.co.jp/info/140100.htm; 'tsol-itc-crawler at toshiba-sol dot co dot jp')
|
20
|
0.10 %
|
|
|
WindowsNT 4.0
|
20
|
0.10 %
|
|
|
Mozilla/5.0 (compatible; heritrix/3.1.1 +http://www.ninjal.ac.jp/corpus_center/ulc/crawl-en)
|
18
|
0.09 %
|
|
|
MADBbot/0.1 (Gathering webpages for data analytics; https://madb.zapto.org/bot.html; ma-db-crawl@googlegroups.com)
|
18
|
0.09 %
|
|
|
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)
|
18
|
0.09 %
|
|
|
DoCoMo1.0; http:
|
18
|
0.09 %
|
|
|
WindowsMe
|
17
|
0.08 %
|
|
|
SafeDNSBot (https://www.safedns.com/searchbot)
|
16
|
0.08 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko
|
16
|
0.08 %
|
|
|
Mozilla/5.0 (compatible; Add Catalog/2.1;)
|
16
|
0.08 %
|
|
|
python-requests/2.31.0
|
16
|
0.08 %
|
|
|
LinkWalker/2.0
|
16
|
0.08 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.0; http://www.majestic12.co.uk/bot.php?+)
|
16
|
0.08 %
|
|
|
Mozilla/5.0 (compatible; SeznamBot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)
|
15
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
|
15
|
0.07 %
|
|
|
TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)
|
15
|
0.07 %
|
|
|
HD nutch agent/Nutch-1.1 (Think)
|
15
|
0.07 %
|
|
|
findlinks/2.1.3 (+http://wortschatz.uni-leipzig.de/findlinks/)
|
14
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)
|
14
|
0.07 %
|
|
|
netEstate NE Crawler (+http://www.website-datenbank.de/)
|
14
|
0.07 %
|
|
|
Nutch12/Nutch-1.2
|
13
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
|
13
|
0.06 %
|
|
|
Mozilla/4.0 (compatible; Blog Search;)
|
13
|
0.06 %
|
|
|
Kyoto-Tohoku-Crawler/v1 (Mozilla-compatible; kyoto-crawler-contact@nlp.ist.i.kyoto-u.ac.jp; http://nlp.ist.i.kyoto-u.ac.jp/?crawling-kt)
|
11
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; Robo/1.0b; http://potaru.com/robo.html)/Nutch-1.2
|
11
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
|
11
|
0.05 %
|
|
|
claudebot
|
11
|
0.05 %
|
|
|
serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com)
|
11
|
0.05 %
|
|
|
rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-wherecat@moz.com)
|
11
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+)
|
10
|
0.05 %
|
|
|
Mozilla/5.0+(compatible;+Robot/1.2)
|
10
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)
|
10
|
0.05 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:26.1) Gecko/20100101 Firefox/26.0
|
10
|
0.05 %
|
|
|
Stratagems Kumo
|
10
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
|
9
|
0.04 %
|
|
|
siclab (cboc-test@lab.ntt.co.jp)
|
9
|
0.04 %
|
|
|
EC2LinkFinder
|
9
|
0.04 %
|
|
|
ichiro/4.0 (http://help.goo.ne.jp/door/crawler.html)
|
9
|
0.04 %
|
|
|
Mozilla/5.0 (compatible; SEOkicks-Robot +http://www.seokicks.de/robot.html)
|
9
|
0.04 %
|
|
|
DoCoMomobile goo;+http:
|
9
|
0.04 %
|
|
|
mahonie, neofonie search:robot/search:robot/0.0.1 (This is the MIA Bot - crawling for mia research project. If you feel unhappy and do not want to be visited by our crawler send an email to spider@neofonie.de; http://spider.neofonie.de; spider@neofonie.de)
|
9
|
0.04 %
|
|
|
Java/1.6.0_22
|
9
|
0.04 %
|
|
|
Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
|
9
|
0.04 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.3.3; http://www.majestic12.co.uk/bot.php?+)
|
9
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko
|
8
|
0.04 %
|
|
|
ICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)
|
8
|
0.04 %
|
|
|
Mozilla/4.0+(compatible;+Robot/1.2 CL)
|
8
|
0.04 %
|
|
|
nutch-1.7/Nutch-1.7
|
8
|
0.04 %
|
|
|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
|
8
|
0.04 %
|
|
|
BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
|
8
|
0.04 %
|
|
|
findlinks/2.0.1 (+http://wortschatz.uni-leipzig.de/findlinks/)
|
7
|
0.03 %
|
|
|
pflab (co2h2onacl@gmail.com)
|
7
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; seoscanners.net/1; +spider@seoscanners.net)
|
7
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant;) Daum 4.1
|
7
|
0.03 %
|
|
|
Mozilla/5.0(compatible;MSIE9.0;WindowsNT6.1;Trident/5.0)
|
7
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; heritrix/3.1.1 +http://www.ninjal.ac.jp/corpus_center/ulc/crawl-en.html)
|
7
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)
|
7
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko
|
7
|
0.03 %
|
|
|
LSSRocketCrawler/1.0 LightspeedSystems
|
7
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; AcoonBot/4.11.0; +http://www.acoon.de/robot.asp)
|
7
|
0.03 %
|
|
|
Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:19.0) Gecko/20100101 Firefox/19.0
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/)
|
6
|
0.03 %
|
|
|
Windows3.1
|
6
|
0.03 %
|
|
|
Barkrowler/0.7 (+http://www.exensa.com/crawl)
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.1; http://www.majestic12.co.uk/bot.php?+)
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/0.99~bl; +http://www.semrush.com/bot.html)
|
6
|
0.03 %
|
|
|
GTWek
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0
|
5
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/)
|
5
|
0.02 %
|
|
|
WindowsNT 5.2
|
5
|
0.02 %
|
|
|
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; Win64; x64; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729
|
5
|
0.02 %
|
|
|
Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
|
5
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/)
|
5
|
0.02 %
|
|
|
CCBot/1.0 (+http://www.commoncrawl.org/bot.html)
|
5
|
0.02 %
|
|
|
Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0 ; .NET CLR 2.0.50215; SL Commerce Client v1.0; Tablet PC 2.0
|
5
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa 4.0
|
5
|
0.02 %
|
|
|
Baiduspider+(+http://www.baidu.jp/spider/)
|
5
|
0.02 %
|
|
|
TsolCrawler/Nutch-1.4
|
5
|
0.02 %
|
|
|
WindowsNT 6.2
|
5
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
|
5
|
0.02 %
|
|
|
TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
|
5
|
0.02 %
|
|
|
netEstate NE Crawler (+http://www.sengine.info/)
|
5
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:38.0) Gecko/20100101 Firefox/38.0 (IndeedBot 1.1)
|
5
|
0.02 %
|
|
|
Mozilla/5.0 (TweetmemeBot/4.0; +http://datasift.com/bot.html) Gecko/20100101 Firefox/31.0
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; DeuSu/5.0.2; +https://deusu.de/robot.html)
|
4
|
0.02 %
|
|
|
Turnitin (https://bit.ly/2UvnfoQ)
|
4
|
0.02 %
|
|
|
Scrapy/1.7.2 (+https://scrapy.org)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; CompSpyBot/1.0; +http://www.compspy.com/spider.html)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:7.0.1) Gecko/20100101 Firefox/7.0.1
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-us; rv:1.9.2.3) Gecko/20100401 YFF35 Firefox/3.6.3
|
4
|
0.02 %
|
|
|
WindowsNT 6.1
|
4
|
0.02 %
|
|
|
Nutch/Nutch-2.0 (Nutch Crawler)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/1.0; +http://ahrefs.com/robot/)
|
4
|
0.02 %
|
|
|
WindowsCE
|
4
|
0.02 %
|
|
|
Mozilla/0.6 Beta (Windows)
|
4
|
0.02 %
|
|
|
findlinks/2.1.5 (+http://wortschatz.uni-leipzig.de/findlinks/)
|
4
|
0.02 %
|
|
|
Googlebot-Image/1.0
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (compatible)
|
4
|
0.02 %
|
|
|
ichiro/3.0 (http://search.goo.ne.jp/option/use/sub4/sub4-1/)
|
4
|
0.02 %
|
|
|
fujilabolx5 Spider/Nutch-1.10
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; LinkpadBot/1.06; +http://www.linkpad.ru)
|
4
|
0.02 %
|
|
|
TosCrawler/Nutch-1.4 (http://www.toshiba.co.jp/rdc/about/crawl_info.htm; 'Rdc-crawler at ml dot toshiba dot co dot jp')
|
4
|
0.02 %
|
|
|
GSLFbot
|
4
|
0.02 %
|
|
|
serpstatbot/1.0 (advanced backlink tracking bot; curl/7.58.0; http://serpstatbot.com/; abuse@serpstatbot.com)
|
4
|
0.02 %
|
|
|
TosCrawler/Nutch-1.5.1 (http://www.toshiba.co.jp/rdc/about/crawl_info.htm; 'Rdc-crawler at ml dot toshiba dot co dot jp')
|
4
|
0.02 %
|
|
|
Toshiba Digital Solution TDSL/Nutch-1.8
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Firefox/24.0
|
4
|
0.02 %
|
|
|
Lynx/2.8.5rel.1 libwww-FM/2.15FC SSL-MM/1.4.1c OpenSSL/0.9.7e-dev
|
4
|
0.02 %
|
|
|
Barkrowler/0.9 (+https://babbar.tech/crawler)
|
4
|
0.02 %
|
|
|
ia_archiver
|
4
|
0.02 %
|
|