|
MacOS
|
4326
|
24.42 %
|
|
|
Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
2165
|
12.22 %
|
|
|
Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
|
1233
|
6.96 %
|
|
|
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
|
835
|
4.71 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
|
658
|
3.71 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
|
598
|
3.38 %
|
|
|
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
550
|
3.10 %
|
|
|
WindowsXP
|
534
|
3.01 %
|
|
|
WindowsNT
|
410
|
2.31 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
|
404
|
2.28 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http://www.semrush.com/bot.html)
|
377
|
2.13 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)
|
297
|
1.68 %
|
|
|
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
243
|
1.37 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)
|
242
|
1.37 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
|
217
|
1.22 %
|
|
|
Go-http-client/1.1
|
178
|
1.00 %
|
|
|
Linux
|
160
|
0.90 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
|
153
|
0.86 %
|
|
|
|
135
|
0.76 %
|
|
|
Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
|
129
|
0.73 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
|
128
|
0.72 %
|
|
|
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
|
117
|
0.66 %
|
|
|
ltx71 - (http://ltx71.com/)
|
117
|
0.66 %
|
|
|
Mozilla/5.0 (compatible; Google-Site-Verification/1.0)
|
115
|
0.65 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
|
115
|
0.65 %
|
|
|
CCBot/2.0 (https://commoncrawl.org/faq/)
|
112
|
0.63 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
|
108
|
0.61 %
|
|
|
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)
|
102
|
0.58 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html)
|
102
|
0.58 %
|
|
|
Google favicon
|
98
|
0.55 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
|
98
|
0.55 %
|
|
|
Stratagems Kumo
|
88
|
0.50 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; Touch; rv:11.0) like Gecko
|
72
|
0.41 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://www.semrush.com/bot.html)
|
71
|
0.40 %
|
|
|
CCBot/2.0 (http://commoncrawl.org/faq/)
|
69
|
0.39 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko
|
68
|
0.38 %
|
|
|
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
|
67
|
0.38 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google Favicon
|
61
|
0.34 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko
|
59
|
0.33 %
|
|
|
Y!J-ASR/0.1 crawler (http://www.yahoo-help.jp/app/answers/detail/p/595/a_id/42716/)
|
56
|
0.32 %
|
|
|
Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io)
|
50
|
0.28 %
|
|
|
msnbot/2.0b (+http://search.msn.com/msnbot.htm)
|
48
|
0.27 %
|
|
|
Mozilla/5.0 (compatible; DnyzBot/1.0)
|
47
|
0.27 %
|
|
|
Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
|
45
|
0.25 %
|
|
|
Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
|
44
|
0.25 %
|
|
|
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
|
44
|
0.25 %
|
|
|
Mozilla/5.0 (compatible; Dataprovider.com)
|
43
|
0.24 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant;) Daum 4.1
|
39
|
0.22 %
|
|
|
Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)
|
39
|
0.22 %
|
|
|
BUbiNG (+http://law.di.unimi.it/BUbiNG.html#wc)
|
31
|
0.17 %
|
|
|
Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
|
31
|
0.17 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://mj12bot.com/)
|
30
|
0.17 %
|
|
|
got (https://github.com/sindresorhus/got)
|
26
|
0.15 %
|
|
|
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)
|
26
|
0.15 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; Touch; rv:11.0) like Gecko
|
26
|
0.15 %
|
|
|
MauiBot (crawler.feedback+wc@gmail.com)
|
25
|
0.14 %
|
|
|
Mozilla/5.0 (compatible; DeuSu/5.0.2; +https://deusu.de/robot.html)
|
24
|
0.14 %
|
|
|
Spiderbot/Nutch-1.7
|
24
|
0.14 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa 4.0
|
24
|
0.14 %
|
|
|
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/1alpha.jp)
|
24
|
0.14 %
|
|
|
Mozilla/5.0 (compatible; Adsbot/3.1)
|
23
|
0.13 %
|
|
|
Wotbox/2.01 (+http://www.wotbox.com/bot/)
|
22
|
0.12 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1~bl; +http://www.semrush.com/bot.html)
|
22
|
0.12 %
|
|
|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
22
|
0.12 %
|
|
|
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze)
|
21
|
0.12 %
|
|
|
Microsoft Office Excel 2013
|
21
|
0.12 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko
|
21
|
0.12 %
|
|
|
facebookexternalhit/1.1;line-poker/1.0
|
21
|
0.12 %
|
|
|
curl/7.52.1
|
20
|
0.11 %
|
|
|
SafeDNSBot (https://www.safedns.com/searchbot)
|
19
|
0.11 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google favicon
|
19
|
0.11 %
|
|
|
ClaudeBot
|
19
|
0.11 %
|
|
|
My Nutch Spider/Nutch-1.10
|
19
|
0.11 %
|
|
|
MADBbot/0.1 (Gathering webpages for data analytics; https://madb.zapto.org/bot.html; ma-db-crawl@googlegroups.com)
|
19
|
0.11 %
|
|
|
Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
|
19
|
0.11 %
|
|
|
Barkrowler experimental crawler - 0.4.7
|
18
|
0.10 %
|
|
|
Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)
|
17
|
0.10 %
|
|
|
TsolCrawler/Nutch-1.4 (http://www.toshiba-sol.co.jp/info/140100.htm; 'tsol-itc-crawler at toshiba-sol dot co dot jp')
|
16
|
0.09 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa/4.0
|
15
|
0.08 %
|
|
|
Mozilla/5.0 (compatible; seoscanners.net/1; +spider@seoscanners.net)
|
14
|
0.08 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:15.0) Gecko/20120716 Firefox/15.0a2
|
14
|
0.08 %
|
|
|
Mozilla/4.0 (compatible; GoogleToolbar 5.0.2124.2070; Windows 6.0; MSIE 8.0.6001.18241)
|
13
|
0.07 %
|
|
|
netEstate NE Crawler (+http://www.website-datenbank.de/)
|
13
|
0.07 %
|
|
|
VelenPublicWebCrawler (velen.io)
|
12
|
0.07 %
|
|
|
Mozilla/5.0 (Windows NT 6.2; WOW64)
|
12
|
0.07 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0
|
12
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1.1~bl; +http://www.semrush.com/bot.html)
|
12
|
0.07 %
|
|
|
Scrapy/2.6.1 (+https://scrapy.org)
|
12
|
0.07 %
|
|
|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
|
12
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/)
|
11
|
0.06 %
|
|
|
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2b1) Gecko/20091014 Firefox/3.6b1 GTB5
|
11
|
0.06 %
|
|
|
serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com)
|
11
|
0.06 %
|
|
|
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; Win64; x64; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729
|
10
|
0.06 %
|
|
|
Barkrowler/0.7 (+http://www.exensa.com/crawl)
|
10
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
|
10
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko
|
10
|
0.06 %
|
|
|
python-requests/2.31.0
|
10
|
0.06 %
|
|
|
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
|
10
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; tracemyfile/1.0)
|
9
|
0.05 %
|
|
|
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)
|
9
|
0.05 %
|
|
|
Java/1.6.0_04
|
9
|
0.05 %
|
|
|
claudebot
|
9
|
0.05 %
|
|
|
Barkrowler/0.9 (+https://babbar.tech/crawler)
|
9
|
0.05 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://www.komodia.com/newwiki/index.php/URL_server_crawler) KomodiaBot/1.0
|
9
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daum 4.1
|
8
|
0.05 %
|
|
|
FriendlyCrawler/Nutch-1.20-SNAPSHOT
|
8
|
0.05 %
|
|
|
AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile Safari
|
8
|
0.05 %
|
|
|
ICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)
|
8
|
0.05 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://url-classification.io/wiki/index.php?title=URL_server_crawler) KStandBot/1.0
|
8
|
0.05 %
|
|
|
Mozilla/5.0+(compatible;+Baiduspider/2.0;++http://www.baidu.com/search/spider.html)
|
8
|
0.05 %
|
|
|
Mozilla/5.0 (Windows; U; MSIE 7.0; Windows NT 6.0; en-US)
|
8
|
0.05 %
|
|
|
nutch-1.8/Nutch-1.8
|
8
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; RukiCrawler/1.0; +http://ruki.rezko.net)
|
8
|
0.05 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:26.1) Gecko/20100101 Firefox/26.0
|
8
|
0.05 %
|
|
|
Y!J-ASR/1.0 crawler (https://support.yahoo-net.jp/PccSearch/s/article/H000007955)
|
7
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0
|
7
|
0.04 %
|
|
|
Turnitin (https://bit.ly/2UvnfoQ)
|
7
|
0.04 %
|
|
|
curl/7.61.1
|
7
|
0.04 %
|
|
|
DoCoMo2.1; +http:
|
7
|
0.04 %
|
|
|
Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5)
|
7
|
0.04 %
|
|
|
AdsBot-Google (+http://www.google.com/adsbot.html)
|
7
|
0.04 %
|
|
|
Toshiba Digital Solution TDSL/Nutch-1.8
|
7
|
0.04 %
|
|
|
Owler (ows.eu/owler)
|
6
|
0.03 %
|
|
|
Microsoft Office Excel 2014
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; rv:36.0) Gecko/20100101 Firefox/36.0
|
6
|
0.03 %
|
|
|
python-requests/2.18.4
|
6
|
0.03 %
|
|
|
TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
|
6
|
0.03 %
|
|
|
curl/7.88.1
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; ExtLinksBot/1.5; +https://extlinks.com/Bot.html)
|
6
|
0.03 %
|
|
|
Scrapy/1.0.3 (+http://scrapy.org)
|
6
|
0.03 %
|
|
|
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5 (.NET CLR 3.5.30729)
|
5
|
0.03 %
|
|
|
Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Firefox/31.0
|
5
|
0.03 %
|
|
|
Barkrowler 0.1.6
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; Linespider/1.1; +https://lin.ee/4dwXkTH)
|
5
|
0.03 %
|
|
|
Java/11.0.10
|
5
|
0.03 %
|
|
|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.0; +https://openai.com/gptbot)
|
5
|
0.03 %
|
|
|
viz/Nutch-1.7
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Trident/7.0; MALCJS; rv:11.0) like Gecko
|
5
|
0.03 %
|
|
|
ia_archiver
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:38.0) Gecko/20100101 Firefox/38.0 (IndeedBot 1.1)
|
5
|
0.03 %
|
|
|
BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
|
5
|
0.03 %
|
|
|
Scrapy/1.7.2 (+https://scrapy.org)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:38.0) Gecko/20100101 Firefox/38.0
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-us; rv:1.9.2.3) Gecko/20100401 YFF35 Firefox/3.6.3
|
4
|
0.02 %
|
|
|
Scrapy/2.8.0 (+https://scrapy.org)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:47.0) Gecko/20100101 Firefox/47.0
|
4
|
0.02 %
|
|
|
Windows98
|
4
|
0.02 %
|
|
|
Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
|
4
|
0.02 %
|
|
|
Mozilla/5.0(compatible;MSIE9.0;WindowsNT6.1;Trident/5.0)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Firefox/24.0
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
|
4
|
0.02 %
|
|
|
WindowsNT 6.2
|
4
|
0.02 %
|
|
|
serpstatbot/1.0 (advanced backlink tracking bot; curl/7.58.0; http://serpstatbot.com/; abuse@serpstatbot.com)
|
4
|
0.02 %
|
|
|
Mozilla/4.0 (compatible; MSIE8.0; Windows NT 6.0) .NET CLR 2.0.50727)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (compatible; Gluten Free Crawler/1.0; +http://glutenfreepleasure.com/)
|
4
|
0.02 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:47.0) Gecko/20100101 Firefox/47.0
|
4
|
0.02 %
|
|
|
MacOSPowerPC
|
4
|
0.02 %
|
|