|
MacOS
|
2705
|
19.21 %
|
|
|
Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
1815
|
12.89 %
|
|
|
Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
|
1210
|
8.59 %
|
|
|
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
|
871
|
6.19 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
|
771
|
5.48 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
|
674
|
4.79 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
|
553
|
3.93 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)
|
363
|
2.58 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http://www.semrush.com/bot.html)
|
329
|
2.34 %
|
|
|
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
302
|
2.14 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)
|
219
|
1.56 %
|
|
|
WindowsNT
|
189
|
1.34 %
|
|
|
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
178
|
1.26 %
|
|
|
Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
|
171
|
1.21 %
|
|
|
Go-http-client/1.1
|
169
|
1.20 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
|
165
|
1.17 %
|
|
|
WindowsXP
|
157
|
1.11 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
|
148
|
1.05 %
|
|
|
Linux
|
148
|
1.05 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
|
141
|
1.00 %
|
|
|
CCBot/2.0 (https://commoncrawl.org/faq/)
|
133
|
0.94 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
|
130
|
0.92 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html)
|
129
|
0.92 %
|
|
|
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)
|
120
|
0.85 %
|
|
|
Y!J-ASR/0.1 crawler (http://www.yahoo-help.jp/app/answers/detail/p/595/a_id/42716/)
|
111
|
0.79 %
|
|
|
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
|
95
|
0.67 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
|
93
|
0.66 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
|
93
|
0.66 %
|
|
|
ltx71 - (http://ltx71.com/)
|
81
|
0.58 %
|
|
|
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
|
67
|
0.48 %
|
|
|
CCBot/2.0 (http://commoncrawl.org/faq/)
|
60
|
0.43 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://www.semrush.com/bot.html)
|
58
|
0.41 %
|
|
|
|
54
|
0.38 %
|
|
|
Mozilla/5.0 (compatible; DnyzBot/1.0)
|
47
|
0.33 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://mj12bot.com/)
|
46
|
0.33 %
|
|
|
Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
|
41
|
0.29 %
|
|
|
Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)
|
39
|
0.28 %
|
|
|
Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
|
38
|
0.27 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant;) Daum 4.1
|
37
|
0.26 %
|
|
|
My Nutch Spider/Nutch-1.10
|
34
|
0.24 %
|
|
|
Mozilla/5.0 (compatible; DeuSu/5.0.2; +https://deusu.de/robot.html)
|
32
|
0.23 %
|
|
|
BUbiNG (+http://law.di.unimi.it/BUbiNG.html#wc)
|
31
|
0.22 %
|
|
|
Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
|
29
|
0.21 %
|
|
|
MADBbot/0.1 (Gathering webpages for data analytics; https://madb.zapto.org/bot.html; ma-db-crawl@googlegroups.com)
|
27
|
0.19 %
|
|
|
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)
|
27
|
0.19 %
|
|
|
MauiBot (crawler.feedback+wc@gmail.com)
|
25
|
0.18 %
|
|
|
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/1alpha.jp)
|
25
|
0.18 %
|
|
|
Mozilla/5.0 (compatible; Adsbot/3.1)
|
24
|
0.17 %
|
|
|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
23
|
0.16 %
|
|
|
Wotbox/2.01 (+http://www.wotbox.com/bot/)
|
22
|
0.16 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa 4.0
|
22
|
0.16 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1~bl; +http://www.semrush.com/bot.html)
|
22
|
0.16 %
|
|
|
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze)
|
21
|
0.15 %
|
|
|
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
|
20
|
0.14 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1.1~bl; +http://www.semrush.com/bot.html)
|
19
|
0.13 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; Touch; rv:11.0) like Gecko
|
18
|
0.13 %
|
|
|
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)
|
18
|
0.13 %
|
|
|
Mozilla/5.0 (compatible; Dataprovider.com)
|
18
|
0.13 %
|
|
|
Barkrowler experimental crawler - 0.4.7
|
18
|
0.13 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa/4.0
|
17
|
0.12 %
|
|
|
TsolCrawler/Nutch-1.4 (http://www.toshiba-sol.co.jp/info/140100.htm; 'tsol-itc-crawler at toshiba-sol dot co dot jp')
|
16
|
0.11 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko
|
15
|
0.11 %
|
|
|
Mozilla/5.0 (compatible; ips-agent)
|
15
|
0.11 %
|
|
|
Mozilla/5.0 (compatible; seoscanners.net/1; +spider@seoscanners.net)
|
15
|
0.11 %
|
|
|
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
|
14
|
0.10 %
|
|
|
netEstate NE Crawler (+http://www.website-datenbank.de/)
|
13
|
0.09 %
|
|
|
Owler (ows.eu/owler)
|
12
|
0.09 %
|
|
|
Scrapy/2.6.1 (+https://scrapy.org)
|
12
|
0.09 %
|
|
|
ICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)
|
12
|
0.09 %
|
|
|
Mozilla/5.0 (Windows NT 6.2; WOW64)
|
11
|
0.08 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:26.1) Gecko/20100101 Firefox/26.0
|
11
|
0.08 %
|
|
|
serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com)
|
11
|
0.08 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko
|
10
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)
|
10
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
|
10
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
|
10
|
0.07 %
|
|
|
python-requests/2.31.0
|
10
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; Dataprovider.com;)
|
10
|
0.07 %
|
|
|
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; Win64; x64; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729
|
9
|
0.06 %
|
|
|
Barkrowler/0.7 (+http://www.exensa.com/crawl)
|
9
|
0.06 %
|
|
|
ClaudeBot
|
9
|
0.06 %
|
|
|
Java/1.6.0_04
|
9
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko
|
9
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
|
9
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://www.komodia.com/newwiki/index.php/URL_server_crawler) KomodiaBot/1.0
|
9
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; Qwantify-prod4300/1.0; +https://help.qwant.com/bot/)
|
8
|
0.06 %
|
|
|
Mozilla/5.0+(compatible;+Baiduspider/2.0;++http://www.baidu.com/search/spider.html)
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://url-classification.io/wiki/index.php?title=URL_server_crawler) KStandBot/1.0
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; RukiCrawler/1.0; +http://ruki.rezko.net)
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0
|
7
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/)
|
7
|
0.05 %
|
|
|
Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5)
|
7
|
0.05 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:38.0) Gecko/20100101 Firefox/38.0
|
7
|
0.05 %
|
|
|
Toshiba Digital Solution TDSL/Nutch-1.8
|
7
|
0.05 %
|
|
|
Barkrowler/0.9 (+https://babbar.tech/crawler)
|
7
|
0.05 %
|
|
|
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5 (.NET CLR 3.5.30729)
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (compatible; Lipperhey-Kaus-Australis/5.0; +https://www.lipperhey.com/en/about/)
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daum 4.1
|
6
|
0.04 %
|
|
|
FriendlyCrawler/Nutch-1.20-SNAPSHOT
|
6
|
0.04 %
|
|
|
python-requests/2.18.4
|
6
|
0.04 %
|
|
|
WindowsNT 6.2
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; Touch; rv:11.0) like Gecko
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US
|
6
|
0.04 %
|
|
|
Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)
|
5
|
0.04 %
|
|
|
Turnitin (https://bit.ly/2UvnfoQ)
|
5
|
0.04 %
|
|
|
Barkrowler 0.1.6
|
5
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0
|
5
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100
|
5
|
0.04 %
|
|
|
Mozilla/5.0 (compatible; Linespider/1.1; +https://lin.ee/4dwXkTH)
|
5
|
0.04 %
|
|
|
Windows2000
|
5
|
0.04 %
|
|
|
TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
|
5
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:52.9) Gecko/20100101 Goanna/3.4 Firefox/52.9 PaleMoon/27.9.0
|
5
|
0.04 %
|
|
|
claudebot
|
5
|
0.04 %
|
|
|
Mozilla/5.0 (compatible; ExtLinksBot/1.5; +https://extlinks.com/Bot.html)
|
5
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:38.0) Gecko/20100101 Firefox/38.0 (IndeedBot 1.1)
|
5
|
0.04 %
|
|
|
BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
|
5
|
0.04 %
|
|
|
Scrapy/1.7.2 (+https://scrapy.org)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-us; rv:1.9.2.3) Gecko/20100401 YFF35 Firefox/3.6.3
|
4
|
0.03 %
|
|
|
Scrapy/2.8.0 (+https://scrapy.org)
|
4
|
0.03 %
|
|
|
Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; rv:36.0) Gecko/20100101 Firefox/36.0
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
|
4
|
0.03 %
|
|
|
Java/11.0.10
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; APCPMS=^N201302070257035267484A37ACF0A41BE63F_2702^; Trident/7.0; rv:11.0) like Gecko,gzip(gfe)
|
4
|
0.03 %
|
|
|
serpstatbot/1.0 (advanced backlink tracking bot; curl/7.58.0; http://serpstatbot.com/; abuse@serpstatbot.com)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:47.0) Gecko/20100101 Firefox/47.0
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:38.0) Gecko/20100101 Firefox/38.0
|
4
|
0.03 %
|
|
|
MacOSPowerPC
|
4
|
0.03 %
|
|