Robots |
1 | 309 | 46.47 | YandexBot/3.0 |
2 | 89 | 13.38 | bingbot/2.0 |
3 | 82 | 12.33 | Googlebot/2.1 |
4 | 49 | 7.37 | compatible Mozilla/5.0 |
5 | 30 | 4.51 | meanpathbot/1.0 |
6 | 29 | 4.36 | DotBot/1.1 |
7 | 15 | 2.26 | MJ12bot/v1.4.5 |
8 | 12 | 1.80 | Baiduspider/2.0 |
9 | 11 | 1.65 | - |
10 | 10 | 1.50 | AhrefsBot/5.0 |
11 | 9 | 1.35 | Linux x86_64 |
12 | 4 | 0.60 | LSSRocketCrawler/1.0 LightspeedSystems |
13 | 4 | 0.60 | aiHitBot/2.8 |
14 | 2 | 0.30 | rogerbot/1.0 (http://moz.com/help/pro/wh... |
15 | 2 | 0.30 | msnbot-media/1.1 (+http://search.msn.com... |
16 | 2 | 0.30 | PagesInventory (robot http://www.pagesin... |
17 | 2 | 0.30 | spbot/4.3.0 |
18 | 2 | 0.30 | 007ac9 Crawler |
19 | 2 | 0.30 | www.osaicbt.com/Nutch-2.2.1 |