|
MacOS
|
2513
|
17.57 %
|
|
|
Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
2003
|
14.00 %
|
|
|
Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
|
1177
|
8.23 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
|
832
|
5.82 %
|
|
|
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
|
780
|
5.45 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
|
718
|
5.02 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
|
696
|
4.87 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)
|
420
|
2.94 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http://www.semrush.com/bot.html)
|
381
|
2.66 %
|
|
|
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
337
|
2.36 %
|
|
|
WindowsXP
|
259
|
1.81 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)
|
256
|
1.79 %
|
|
|
WindowsNT
|
204
|
1.43 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
|
189
|
1.32 %
|
|
|
Go-http-client/1.1
|
168
|
1.17 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
|
157
|
1.10 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html)
|
150
|
1.05 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
|
148
|
1.03 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
|
141
|
0.99 %
|
|
|
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
133
|
0.93 %
|
|
|
Linux
|
124
|
0.87 %
|
|
|
Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
|
121
|
0.85 %
|
|
|
CCBot/2.0 (https://commoncrawl.org/faq/)
|
118
|
0.83 %
|
|
|
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)
|
104
|
0.73 %
|
|
|
Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
|
99
|
0.69 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://www.semrush.com/bot.html)
|
95
|
0.66 %
|
|
|
Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
|
94
|
0.66 %
|
|
|
ltx71 - (http://ltx71.com/)
|
77
|
0.54 %
|
|
|
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
|
67
|
0.47 %
|
|
|
Mozilla/5.0 (compatible; Dataprovider.com)
|
60
|
0.42 %
|
|
|
CCBot/2.0 (http://commoncrawl.org/faq/)
|
60
|
0.42 %
|
|
|
|
55
|
0.38 %
|
|
|
Mozilla/5.0 (compatible; DnyzBot/1.0)
|
47
|
0.33 %
|
|
|
Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://mj12bot.com/)
|
43
|
0.30 %
|
|
|
Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)
|
40
|
0.28 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1.1~bl; +http://www.semrush.com/bot.html)
|
39
|
0.27 %
|
|
|
Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
|
35
|
0.24 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant;) Daum 4.1
|
31
|
0.22 %
|
|
|
Y!J-ASR/0.1 crawler (http://www.yahoo-help.jp/app/answers/detail/p/595/a_id/42716/)
|
31
|
0.22 %
|
|
|
BUbiNG (+http://law.di.unimi.it/BUbiNG.html#wc)
|
29
|
0.20 %
|
|
|
MauiBot (crawler.feedback+wc@gmail.com)
|
25
|
0.17 %
|
|
|
Mozilla/5.0 (compatible; SemrushBot/1~bl; +http://www.semrush.com/bot.html)
|
25
|
0.17 %
|
|
|
My Nutch Spider/Nutch-1.10
|
25
|
0.17 %
|
|
|
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
|
25
|
0.17 %
|
|
|
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/1alpha.jp)
|
25
|
0.17 %
|
|
|
Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
|
24
|
0.17 %
|
|
|
Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
|
24
|
0.17 %
|
|
|
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)
|
24
|
0.17 %
|
|
|
Mozilla/5.0 (compatible; Adsbot/3.1)
|
23
|
0.16 %
|
|
|
Wotbox/2.01 (+http://www.wotbox.com/bot/)
|
22
|
0.15 %
|
|
|
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze)
|
21
|
0.15 %
|
|
|
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
|
21
|
0.15 %
|
|
|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
21
|
0.15 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa 4.0
|
20
|
0.14 %
|
|
|
Mozilla/5.0 (compatible; DeuSu/5.0.2; +https://deusu.de/robot.html)
|
19
|
0.13 %
|
|
|
TsolCrawler/Nutch-1.4 (http://www.toshiba-sol.co.jp/info/140100.htm; 'tsol-itc-crawler at toshiba-sol dot co dot jp')
|
19
|
0.13 %
|
|
|
MADBbot/0.1 (Gathering webpages for data analytics; https://madb.zapto.org/bot.html; ma-db-crawl@googlegroups.com)
|
19
|
0.13 %
|
|
|
AdsBot-Google (+http://www.google.com/adsbot.html)
|
19
|
0.13 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko
|
18
|
0.13 %
|
|
|
AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile Safari
|
18
|
0.13 %
|
|
|
Barkrowler experimental crawler - 0.4.7
|
18
|
0.13 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; Touch; rv:11.0) like Gecko
|
17
|
0.12 %
|
|
|
SafeDNSBot (https://www.safedns.com/searchbot)
|
16
|
0.11 %
|
|
|
Mozilla/5.0 (compatible; ips-agent)
|
16
|
0.11 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko
|
15
|
0.10 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa/4.0
|
14
|
0.10 %
|
|
|
ICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)
|
14
|
0.10 %
|
|
|
netEstate NE Crawler (+http://www.website-datenbank.de/)
|
13
|
0.09 %
|
|
|
Mozilla/5.0 (Windows NT 6.2; WOW64)
|
12
|
0.08 %
|
|
|
Scrapy/2.6.1 (+https://scrapy.org)
|
12
|
0.08 %
|
|
|
python-requests/2.31.0
|
12
|
0.08 %
|
|
|
Mozilla/5.0 (compatible; seoscanners.net/1; +spider@seoscanners.net)
|
11
|
0.08 %
|
|
|
ClaudeBot
|
11
|
0.08 %
|
|
|
serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com)
|
11
|
0.08 %
|
|
|
Owler (ows.eu/owler)
|
10
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
|
10
|
0.07 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:26.1) Gecko/20100101 Firefox/26.0
|
10
|
0.07 %
|
|
|
Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
|
10
|
0.07 %
|
|
|
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; Win64; x64; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729
|
9
|
0.06 %
|
|
|
Java/1.6.0_04
|
9
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://www.komodia.com/newwiki/index.php/URL_server_crawler) KomodiaBot/1.0
|
9
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)
|
8
|
0.06 %
|
|
|
Barkrowler/0.7 (+http://www.exensa.com/crawl)
|
8
|
0.06 %
|
|
|
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
|
8
|
0.06 %
|
|
|
Mozilla/5.0+(compatible;+Baiduspider/2.0;++http://www.baidu.com/search/spider.html)
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://url-classification.io/wiki/index.php?title=URL_server_crawler) KStandBot/1.0
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; RukiCrawler/1.0; +http://ruki.rezko.net)
|
8
|
0.06 %
|
|
|
claudebot
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; Dataprovider.com;)
|
8
|
0.06 %
|
|
|
Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/)
|
7
|
0.05 %
|
|
|
Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5)
|
7
|
0.05 %
|
|
|
Mozilla/5.0 (compatible; Qwantify-prod4300/1.0; +https://help.qwant.com/bot/)
|
7
|
0.05 %
|
|
|
Barkrowler/0.9 (+https://babbar.tech/crawler)
|
7
|
0.05 %
|
|
|
HTTPClient/1.0 (2.8.3, ruby 2.7.4 (2021-07-07))
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (compatible; tracemyfile/1.0; +bot@tracemyfile.com)
|
6
|
0.04 %
|
|
|
FriendlyCrawler/Nutch-1.20-SNAPSHOT
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; rv:36.0) Gecko/20100101 Firefox/36.0
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Firefox/24.0
|
6
|
0.04 %
|
|
|
python-requests/2.18.4
|
6
|
0.04 %
|
|
|
WindowsNT 6.2
|
6
|
0.04 %
|
|
|
Toshiba Digital Solution TDSL/Nutch-1.8
|
6
|
0.04 %
|
|
|
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5 (.NET CLR 3.5.30729)
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:60.0) Gecko/20100101 Firefox/60.0
|
5
|
0.03 %
|
|
|
Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Firefox/31.0
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:34.0) Gecko/20100101 Firefox/34.0
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
|
5
|
0.03 %
|
|
|
Barkrowler 0.1.6
|
5
|
0.03 %
|
|
|
Mediapartners-Google
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; SeznamBot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; Linespider/1.1; +https://lin.ee/4dwXkTH)
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
|
5
|
0.03 %
|
|
|
TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
|
5
|
0.03 %
|
|
|
MacOSPowerPC
|
5
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; rv:38.0) Gecko/20100101 Firefox/38.0 (IndeedBot 1.1)
|
5
|
0.03 %
|
|
|
BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
|
5
|
0.03 %
|
|
|
Scrapy/1.7.2 (+https://scrapy.org)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-us; rv:1.9.2.3) Gecko/20100401 YFF35 Firefox/3.6.3
|
4
|
0.03 %
|
|
|
Scrapy/2.8.0 (+https://scrapy.org)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daum 4.1
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; WOW64; rv:35.0) Gecko/20100101 Firefox/35.0
|
4
|
0.03 %
|
|
|
Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
|
4
|
0.03 %
|
|
|
Java/11.0.10
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
|
4
|
0.03 %
|
|
|
serpstatbot/1.0 (advanced backlink tracking bot; curl/7.58.0; http://serpstatbot.com/; abuse@serpstatbot.com)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (compatible; ExtLinksBot/1.5; +https://extlinks.com/Bot.html)
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:47.0) Gecko/20100101 Firefox/47.0
|
4
|
0.03 %
|
|
|
Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; Touch; rv:11.0) like Gecko
|
4
|
0.03 %
|
|