List of Robot Agent
รายชื่อ Robot ต่างๆของ Web Spider
สามารถอ่านค่านี้ได้จากตัวแปร $_SERVER[HTTP_USER_AGENT]
สามารถอ่านค่านี้ได้จากตัวแปร $_SERVER[HTTP_USER_AGENT]
| ADSAComponent | ADSAComponent (postmaster@cnds.ucd.ie) |
| AOL 3.0 | Mozilla/2.0 (Compatible; AOL-IWENG 3.0; Win16) |
| ASPseek 1.2.10 | ASPseek/1.2.10 |
| ASPseek 1.2.11 | ASPseek/1.2.11 |
| ASPseek 1.2.12 | ASPseek/1.2.12 |
| Almaden c01 | http://www.almaden.ibm.com/cs/crawler [c01] |
| Almaden | http://www.almaden.ibm.com/cs/crawler [fc3] |
| Almaden wf224 | http://www.almaden.ibm.com/cs/crawler [wf224] |
| Almaden wf55 | http://www.almaden.ibm.com/cs/crawler [wf55] |
| Amfibibot 0.06 | Amfibibot/0.06 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com) |
| Amsterdam 2002 | Mozilla/4.0 (Search Engine Marketing Tactics Amsterdam 2002 Information Spider) |
| AnswerBus | AnswerBus (http://www.answerbus.com/) |
| Antibot 1.1.11 | antibot-V1.1.11/i586-linux-2.2 |
| Antibot 1.1.13 | antibot-V1.1.13/i586-linux-2.2 |
| Antibot 1.2.0 | antibot-V1.2.0/redhat-linux-9 |
| Appie 1.1 | appie 1.1 (www.walhello.com) |
| Argus 1.1 | Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com) |
| Art-Online 0.9 | Art-Online.com 0.9(Beta) |
| Ask Jeeves | Mozilla/2.0 (compatible; Ask Jeeves) |
| Ask Jeeves Teoma | Mozilla/2.0 (compatible; Ask Jeeves/Teoma) |
| AvantGo 3.2 | Mozilla/3.0 (compatible; AvantGo 3.2) |
| BDFetch | BDFetch |
| BDNcentral Crawler 2.3 | BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) |
| BDNcentral Crawler 2.3 | BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686) |
| BaiDuSpider | BaiDuSpider |
| BaiDuSpider | Baiduspider+(+http://www.baidu.com/search/spider.htm) |
| Battlebot | battlebot |
| Big Brother | Big Brother (http://pauillac.inria.fr/~fpottier/) |
| BlogBot 1.2 | BlogBot/1.2 |
| Boitho-dc 0.4 | boitho.com-dc/0.4 ( http://www.boitho.com/dcbot.html ) |
| Boitho-dc 0.5 | boitho.com-dc/0.5 ( http://www.boitho.com/dcbot.html ) |
| Boitho-dc 0.66 | boitho.com-dc/0.66 ( http://www.boitho.com/dcbot.html ) |
| Boitho-robot 1.0 | boitho.com-robot/1.0 |
| Boitho-robot 1.1 | boitho.com-robot/1.1 |
| BorderManager 3.0 | Mozilla/4.0 (compatible; BorderManager 3.0) |
| BrailleBot 1.0 | BrailleBot 1.0 |
| BruinBot | BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html) |
| Bumblebee 1.0 | bumblebee/1.0 (bumblebee@relevare.com; http://www.relevare.com/) |
| CARI Crawler | Computer_and_Automation_Research_Institute_Crawler (nospamspidernospam@spider.ilab.sztakinospam.hunospam) |
| CARI Crawler | Computer_and_Automation_Research_Institute_Crawler (spider@spider.ilab.sztaki.hu) |
| Cd34 0.1 | cd34/0.1 |
| Cerberian Drtrs 3.0 | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.0-Build-41) |
| Cerberian Drtrs 3.0 | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.0-Build-43) |
| Cerberian Drtrs | CerberianDrtrs/Version-3.0-Release-24 |
| Cerberian Drtrs | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.0-Build-40) |
| Cerberian Drtrs | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-11) |
| Cerberian Drtrs | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-12) |
| Cerberian Drtrs | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-13) |
| Cerberian Drtrs | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-16) |
| Cerberian Drtrs | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-17) |
| Cerberian Drtrs | Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.2-Build-0) |
| CipinetBot | CipinetBot (http://www.cipinet.com/bot.html) |
| Clushbot 2.1 | Clushbot/2.1 (+http://www.clush.com/bot.html) |
| Clushbot 3.21 | Clushbot/3.21-BinaryFury (+http://www.clush.com/bot.html) |
| Clushbot 3.23 | Clushbot/3.23-BinaryFury (+http://www.clush.com/bot.html) |
| Clushbot 3.24 | Clushbot/3.24-BinaryFury (+http://www.clush.com/bot.html) |
| Clushbot 3.6 | Clushbot/3.6-BinaryFury (+http://www.clush.com/bot.html) |
| Clushbot 3.9 | Clushbot/3.9-BinaryFury (+http://www.clush.com/bot.html) |
| ComMOOnity LambdaMOO 1.8.1 | ComMOOnity LambdaMOO/1.8.1 |
| ConveraCrawler 0.1 | CrawlConvera0.1 (CrawlConvera@yahoo.com) |
| ConveraCrawler 0.1 | CrawlConvera0.1 (www.authoritativeweb.com) |
| ConveraCrawler 0.2 | ConveraCrawler/0.2 |
| ConveraCrawler 0.5 | ConveraCrawler/0.5 (+http://www |
| Cosmos 0.9 | cosmos/0.9_(robot@xyleme.com) |
| Cowbot 0.1 | Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) |
| Cowbot 0.1.1 | Cowbot-0.1.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) |
| Crawl_Application | Crawl_Application |
| CrocCrawler 3.3 | CrocCrawler v3.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686) |
| CrocCrawler 4.3 | CrocCrawler v4.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686) |
| Custo 2.0 | Custo 2.0 (www.netwu.com) |
| CydralSpider 1.9 | CydralSpider/1.9 (Cydral Web Image Search; http://www.cydral.com) |
| DeMozulator 1.0 | DeMozulator 1.0 (MacOS, dMoz URL Check Agent, trebor@animeigo.com) |
| DeepIndex | DeepIndex (http://www.deepindex.com) |
| DoCoMo 1.0 | DoCoMo/1.0/N504i/c10/TB |
| DoCoMo 1.0 | DoCoMo/1.0/P504iS/c10/TB |
| Dual Proxy | Dual Proxy |
| Dumbot | Dumbot(version 0.1 beta - dumbfind.com) |
| Dumbot | Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html) |
| Dumbot | Dumbot(version 0.1 beta) |
| E-SocietyRobot | e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/) |
| EARTHCOM.info 1.2 | EARTHCOM.info/1.2 |
| EmailSiphon | EmailSiphon |
| Enterprise_Search 1.00.136 | Enterprise_Search/1.00.136;MSSQL (http://www.innerprise.net/es-spider.asp) |
| Exactseek-crawler 2.63 | exactseek-crawler-2.63 (crawler@exactseek.com) |
| Exactseek-crawler 2.63 | exactseek-crawler-2.63 crawler@exactseek.com |
| Exactseek-crawler 2.63 | exactseek-crawler-2.63-5 (crawler@exactseek.com) |
| Exactseek-crawler 2.63 | exactseek-crawler-2.63-5 crawler@exactseek.com |
| Explorer 6 | Explorer 6 |
| FAST Enterprise Crawler 6 | FAST Enterprise Crawler/6 (crawler@fast.no) |
| FAST Enterprise Crawler 6 | FAST Enterprise Crawler/6 (www.fastsearch.com) |
| FAST FirstPage retriever | FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0) |
| FAST-WebCrawler 3.2 | FAST-WebCrawler/3.2 test |
| FAST-WebCrawler 3.4 | FAST-WebCrawler/3.4/PartnerSite (crawler@fast.no; http://fast.no/....php?c=faqs/crawler) |
| FAST-WebCrawler 3.6 | FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
| FAST-WebCrawler 3.6 | FAST-WebCrawler/3.6/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp) |
| FAST-WebCrawler 3.6 | FAST-WebCrawler/3.6/FirstPage (crawler@fast.no; http://fast.no/....php?c=faqs/crawler) |
| FAST-WebCrawler 3.7 | FAST-WebCrawler/3.7 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
| FAST-WebCrawler 3.7 | FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp) |
| FAST-WebCrawler 3.8 | FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
| FAST-WebCrawler 3.8 | FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://www.alltheweb.com/...p/webmaster/crawler) |
| FAST-WebCrawler 3.8 | FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/...p/webmaster/crawler) |
| FAST-WebCrawler 3.8 | FAST-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
| FAST-WebCrawler 3.x | FAST-WebCrawler/3.x Multimedia |
| FAST-WebCrawler 3.x | FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no) |
| FDSE robot | Mozilla/4.0 (compatible: FDSE robot) |
| FastBug | FastBug http://www.ay-up.com |
| Favicon | favicon finder at http://iconsurf.com/ |
| Favicon | favicon monitor at http://iconsurf.com/ |
| Filangy 0.01 | Filangy/0.01-beta (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com) |
| Filangy 1.01 | Filangy/1.01 (Filangy; http://www.filangy.com/....jsp?inc=robots.jsp; filangy-agent@filangy.com) |
| Filangy 1.01 | Filangy/1.01 (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com) |
| FindLinks 0.71 | FindLinks/0.71 (+http://wortschatz.uni-leipzig.de/findlinks/) |
| Findlinks 0.82 | findlinks/0.82 (+http://wortschatz.uni-leipzig.de/findlinks/) |
| Findlinks 0.87 | findlinks/0.87 (+http://wortschatz.uni-leipzig.de/findlinks/) |
| Findlinks 0.89 | findlinks/0.89 (+http://wortschatz.uni-leipzig.de/findlinks/) |
| Firefly 1.0 | Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5) |
| FlickBot 1.1 | Flickbot 1.1 RPT-HTTPClient/0.3-3 |
| FlickBot 2.0 | FlickBot 2.0 RPT-HTTPClient/0.3-3 |
| Fluffy the spider | Mozilla/3.0 (compatible; Fluffy the spider; http://www.searchhippo.com/; info@searchhippo.com) |
| FusionBot | Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; http://www.pgts.com.au/; +http://www.galaxy.com/info/crawler.html) |
| FyberSpider | FyberSpider (+http://www.fybersearch.com/fyberspider.php) |
| GAIS Robot 1.1A2 | GAIS Robot/1.1A2 |
| Gaisbot 3.0 | Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) |
| GalaxyBot 1.0 | GalaxyBot/1.0 (http://www.galaxy.com/galaxybot.html) |
| Gatherer 0.9 | gatherer/0.9 |
| Gazz 5.0 | gazz/5.0 (gazz@nttr.co.jp) |
| Generic | Generic |
| GeonaBot 1.0 | GeonaBot 1.0; http://www.geona.com/ |
| GeonaBot 1.1 | GeonaBot/1.1; http://www.geona.com/ |
| GetRight 4.5 | GetRight/4.5e |
| Gigabot 1.0 | Gigabot/1.0 |
| Girafabot | Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com) |
| Goldfire Server | Goldfire Server |
| Googlebot 2.1 | Googlebot/2.1 (+http://www.google.com/bot.html) |
| Googlebot 2.1 | Googlebot/2.1 (+http://www.googlebot.com/bot.html) |
| Googlebot 2.1 | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
| Googlebot Test | Googlebot/Test (+http://www.googlebot.com/bot.html) |
| Googlebot-Image 1.0 | Googlebot-Image/1.0 |
| Googlebot-Image 1.0 | Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html) |
| Green Research, Inc. | Green Research, Inc. |
| GregBot | GregBot (compatible; MSIE; Windows; Q312461) |
| Grub-client 0.3.0 | Mozilla/4.0 (compatible; grub-client-0.3.0; Crawl your own stuff with http://grub.org) |
| Grub-client 1.0.3 | Mozilla/4.0 (compatible; grub-client-1.0.3; Crawl your own stuff with http://grub.org) |
| Grub-client 1.0.4 | Mozilla/4.0 (compatible; grub-client-1.0.4; Crawl your own stuff with http://grub.org) |
| Grub-client 1.0.5 | Mozilla/4.0 (compatible; grub-client-1.0.5; Crawl your own stuff with http://grub.org) |
| Grub-client 1.0.6 | Mozilla/4.0 (compatible; grub-client-1.0.6; Crawl your own stuff with http://grub.org) |
| Grub-client 1.0.7 | Mozilla/4.0 (compatible; grub-client-1.0.7; Crawl your own stuff with http://grub.org) |
| Grub-client 1.07 | Mozilla/4.0 (compatible; grub-client-1.07; Crawl your own stuff with http://grub.org) |
| Grub-client 1.1.1 | Mozilla/4.0 (compatible; grub-client-1.1.1; Crawl your own stuff with http://grub.org) |
| Grub-client 1.2.1 | Mozilla/4.0 (compatible; grub-client-1.2.1; Crawl your own stuff with http://grub.org) |
| Grub-client 1.3.1 | Mozilla/4.0 (compatible; grub-client-1.3.1; Crawl your own stuff with http://grub.org) |
| Grub-client 1.3.7 | Mozilla/4.0 (compatible; grub-client-1.3.7; Crawl your own stuff with http://grub.org) |
| Grub-client 1.4.3 | Mozilla/4.0 (compatible; grub-client-1.4.3; Crawl your own stuff with http://grub.org) |
| Grub-client 1.5.3 | Mozilla/4.0 (compatible; grub-client-1.5.3; Crawl your own stuff with http://grub.org) |
| Grub-client 2.3 | Mozilla/4.0 (compatible; grub-client-2.3) |
| Grub-client | grub-client |
| GulperBot 0.2.4 | Crawler [en] (compatible; Crawler Gulper Web Bot 0.2.4 www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot) |
| GulperBot 0.2.4 | Mozilla/5.0 [en] (compatible; Gulper Web Bot 0.2.4 www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot) |
| HTTPConnect | HTTPConnect |
| HTTrack 3.0x | Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98) |
| Harvest-NG 1.0.2 | Harvest-NG/1.0.2 |
| Hatena Antenna 0.4 | Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot) |
| Hatena Antenna 0.4 | Hatena Antenna/0.4 (http://a.hatena.ne.jp/help) |
| Hget 0.3 | hget/0.3 |
| Hitwise Spider 1.0 | Hitwise Spider v1.0 http://www.hitwise.com |
| Htdig 3.1.5 | htdig/3.1.5 (admin@ipc-opc.lan) |
| Htdig 3.1.5 | htdig/3.1.5 (unconfigured@htdig.searchengine.maintainer) |
| Htdig 3.1.6 | htdig/3.1.6 (http://computerorgs.com) |
| Htdig | htdig |
| Html Link Validator | Html Link Validator (www.lithopssoft.com) |
| Httpcheck 1.0 | Httpcheck/1.0 (Perl 5.006001) |
| Httpget 5.2.2 | httpget-5.2.2 |
| ICS 1.2.105 | Mozilla/4.0 (compatible; ICS 1.2.105) |
| IPiumBot | IPiumBot laurion(dot)com |
| IRLbot 1.0 | IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler) |
| Ia_archiver | ia_archiver |
| IcabotAccept | lcabotAccept: */* |
| Ichiro 1.0 | ichiro/1.0 (ichiro@nttr.co.jp) |
| IconSurf 2.0 | IconSurf/2.0 favicon monitor (see http://iconsurf.com/robot.html) |
| IlTrovatore-Setaccio 0.03 | IlTrovatore-Setaccio/0.03-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
| IlTrovatore-Setaccio 1.2 | IlTrovatore-Setaccio/1.2 (+http://www.iltrovatore.it/aiuto/faq.html) |
| IlTrovatore-Setaccio 1.2 | IlTrovatore-Setaccio/1.2 (Indexing; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) |
| IlTrovatore-Setaccio 1.2 | IlTrovatore-Setaccio/1.2 (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
| IlTrovatore-Setaccio 1.2 | IlTrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
| IlTrovatore-Setaccio 1.2 | IlTrovatore-Setaccio/1.2-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
| IlTrovatore-Setaccio | IlTrovatore-Setaccio (+http://www.iltrovatore.it) |
| Iltrovatore-Setaccio 0.3 | Iltrovatore-Setaccio/0.3-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
| Iltrovatore-Setaccio 1.2 | Iltrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
| Iltrovatore-Setaccio | Iltrovatore-Setaccio |
| Imagefetch 0.1 | imagefetch/0.1 libwww-perl/5.66 |
| Indy Library | Mozilla/3.0 (compatible; Indy Library) |
| InelaBot 0.2 | InelaBot/0.2 (+http://inelegant.org/bot) |
| InfoSeek Sidewinder 1.0A | InfoSeek Sidewinder/1.0A |
| Infoseek SideWinder 1.45 | Infoseek SideWinder/1.45 (Compatible; MSIE 10.0; UNIX) |
| Infoseek SideWinder 2.0B | Infoseek SideWinder/2.0B (Linux 2.4 i686) |
| Ingrid 3.0 | Mozilla/3.0 (INGRID/3.0 MT; webcrawler@NOSPAMexperimental.net; http://aanmelden.ilse.nl/...nmeld_mode=webhints) |
| Inktomi slurp | Mozilla/3.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
| Inktomi slurp | Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
| Inktomi slurp | Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
| Inktomi slurp | Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
| Inktomi slurp | Slurp/si-emb (slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
| InternetLinkAgent 3.1 | InternetLinkAgent/3.1 |
| Istarthere | http://www.istarthere.com (spider@istarthere.com) |
| Java 1.4.0 | Java1.4.0 |
| JoBo 1.3 | JoBo/1.3 (http://www.matuschek.net/jobo.html) |
| K2spider | k2spider |
| KMcrawler | KMcrawler |
| Knowledge 0.2 | Knowledge.com/0.2 |
| Knowledge 0.3 | Knowledge.com/0.3 |
| Knowledge Engine | Knowledge Engine |
| Kuloko-bot 0.2 | kuloko-bot/0.2 |
| LNSpiderguy | LNSpiderguy |
| Larbin 2.6.2 | Larbin larbin2.6.2@unspecified.mail |
| Larbin 2.6.2 | larbin_2.6.2 (kalou@kalou.net) |
| Larbin 2.6.2 | larbin_2.6.2 (larbin2.6.2@unspecified.mail) |
| Larbin 2.6.2 | larbin_2.6.2 (larbin@correa.org) |
| Larbin 2.6.2 | larbin_2.6.2 (pimenas@softnet.tuc.gr) |
| Larbin 2.6.2 | larbin_2.6.2 (pimenas@systems.tuc.gr) |
| Larbin 2.6.2 | larbin_2.6.2 (sumeet_sobti@yahoo.com) |
| Larbin 2.6.2 | larbin_2.6.2 (vitalbox1@hotmail.com) |
| Larbin 2.6.2 | larbin_2.6.2 (vshelk@yahoo.com) |
| Larbin 2.6.2 | larbin_2.6.2 larbin2.6.2@unspecified.mail |
| Larbin 2.6.2 | larbin_2.6.2 larbin@correa.org |
| Larbin 2.6.2 | larbin_2.6.2 pimenas@systems.tuc.gr |
| Larbin 2.6.2 | larbin_2.6.2 sumeet_sobti@yahoo.com |
| Larbin 2.6.2 | larbin_2.6.2 vitalbox1@hotmail.com |
| Larbin 2.6.3 | larbin_2.6.3 (andreas.beder@chello.at) |
| Larbin 2.6.3 | larbin_2.6.3 (larbin-crawler@un.bewaff.net) |
| Larbin 2.6.3 | larbin_2.6.3 (larbin2.6.3@unspecified.mail) |
| Larbin 2.6.3 | larbin_2.6.3 (pimenas@softnet.tuc.gr) |
| Larbin 2.6.3 | larbin_2.6.3 larbin2.6.3@unspecified.mail |
| Larbin 2.6.3 | larbin_2.6.3_for_(http://cosco.hiit.fi/search/) (Tomi.Silander@hiit.fi) |
| Larbin 2.6.3 | larbin_2.6.3_for_(http://cosco.hiit.fi/search/) (tsilande@hiit.fi) |
| Larbin 2.6.3 | larbin_2.6.3_for_(http://cosco.hiit.fi/search/) Tomi.Silander@hiit.fi |
| Larbin 2.6.3 | larbin_2.6.3_for_(http://cosco.hiit.fi/search/) tsilande@hiit.fi |
| Larbin 2.63 | eseek-crawler-larbin-2.63 (crawler@exactseek.com) |
| Larbin 2.63 | eseek-crawler-larbin-2.63 crawler@exactseek.com |
| Larbin | LARBIN-EXPERIMENTAL (efp@gmx.net) |
| Larbin | LARBIN-EXPERIMENTAL efp@gmx.net |
| Larbin | Larbin (larbin2.6.2@unspecified.mail) |
| Larbin | MSIE-5.13 (larbin@unspecified.mail) |
| Larbin | MSIE-5.13 larbin@unspecified.mail |
| Larbin | Mozilla (la2@unspecified.mail) |
| Larbin | Mozilla la2@unspecified.mail |
| Larbin | Mozilla/4.0 (efp@gmx.net) |
| Larbin | Mozilla/4.0 efp@gmx.net |
| Larbin | SearchGuild_DMOZ_Experiment (chris@searchguild.com) |
| Larbin | SearchGuild_DMOZ_Experiment chris@searchguild.com |
| Larbin | WinampMPEG/2.00 (larbin@unspecified.mail) |
| Larbin | WinampMPEG/2.00 larbin@unspecified.mail |
| Larbin | larbin (samualt9@bigfoot.com) |
| Larbin | larbin samualt9@bigfoot.com |
| Larbin | larbin_extended (larbin@oktie.com) |
| Larbin | larbin_test (nobody@airmail.etn) |
| Libwww-MGET 1.0 | libwww-MGET/1.0 libwww/5.2.8 |
| Libwww-perl 5.3.2 | / libwww/5.3.2 |
| Libwww-perl 5.4.0 | / libwww/5.4.0 |
| Libwww-perl 5.48 | libwww-perl/5.48 |
| Libwww-perl 5.50 | libwww-perl/5.50 |
| Libwww-perl 5.51 | libwww-perl/5.51 |
| Libwww-perl 5.52 | libwww-perl/5.52 FP/4.0 |
| Libwww-perl 5.53 | libwww-perl/5.53 |
| Libwww-perl 5.63 | libwww-perl/5.63 |
| Libwww-perl 5.64 | libwww-perl/5.64 |
| Libwww-perl 5.65 | MyApp/0.1 libwww-perl/5.65 |
| Libwww-perl 5.65 | libwww-perl/5.65 |
| Libwww-perl 5.66 | rawiswar/0.1 libwww-perl/5.66 |
| Libwww-perl 5.68 | libwww-perl/5.68 |
| Libwww-perl 5.69 | VanillaZilla/0.1 libwww-perl/5.69 |
| Libwww-perl 5.69 | libwww-perl/5.69 |
| Libwww-perl 5.74 | libwww-perl/5.74 |
| Libwww-perl 5.75 | libwww-perl/5.75 |
| Libwww-perl 5.76 | libwww-perl/5.76 |
| Libwww-perl 5.800 | libwww-perl/5.800 |
| Libwww-perl 5.801 | libwww-perl/5.801 |
| Libwww-perl 5.802 | libwww-perl/5.802 |
| Libwww-perl 5.803 | libwww-perl/5.803 |
| Libwww-perl | Perl-Win32::Internet/0.082 |
| LimeBot 1.0 | LimeBot/1.0 (+www.cruiselime.com/LimeBot.php) |
| LinkLint-checkonly 2.3.5 | LinkLint-checkonly/2.3.5 |
| Linkbot 3.0 | Linkbot 3.0 |
| Linknzbot 2004 | Linknzbot 2004/(+http://www.linknz.co.nz/robot.php) |
| Linknzbot | Linknzbot/ (+http://www.linknz.co.nz/robot.php) |
| Links SQL | Links SQL (http://gossamer-threads.com/scripts/links-sql/) |
| Lite Bot 0616B | Lite Bot 0616B |
| Look | Look.com |
| Lwp-request 1.29 | lwp-trivial/1.29 |
| Lwp-request 1.35 | lwp-trivial/1.35 |
| Lwp-request 1.36 | lwp-trivial/1.36 |
| Lwp-request 2.01 | lwp-request/2.01 |
| Lwp-request 5.48 | LWP::Simple/5.48 |
| Lwp-request 5.65 | LWP::Simple/5.65 |
| Lycos_Spider | Lycos_Spider_(modspider) |
| MS Data Access | Microsoft Data Access Internet Publishing Provider Cache Manager |
| MS Data Access | Microsoft Data Access Internet Publishing Provider DAV |
| MS Data Access | Microsoft Data Access Internet Publishing Provider DAV 1.1 |
| MS Data Access | Microsoft Data Access Internet Publishing Provider Protocol Discovery |
| MS FrontPage 4.0 | MSFrontPage/4.0 |
| MS FrontPage 4.0 | Mozilla/2.0 (compatible; MS FrontPage 4.0) |
| MS FrontPage 5.0 | MSFrontPage/5.0 |
| MS FrontPage 5.0 | Mozilla/2.0 (compatible; MS FrontPage 5.0) |
| MSIECrawler | Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; MSIECrawler) |
| MSIECrawler | Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; Q312461; BTopenworld; MSIECrawler) |
| MSIECrawler | Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; MSIECrawler) |
| MSIECrawler | Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; MSIECrawler) |
| MSIECrawler | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Q312461; MSIECrawler) |
| MSIECrawler | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; matlas-2.0.2501; MSIECrawler) |
| MSIECrawler | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler) |
| MSProxy 2.0 | MSProxy/2.0 |
| MSRBot 0.1 | MSRBOT/0.1 (http://research.microsoft.com/research/sv/msrbot/) |
| Mediapartners-Google 2.1 | Mediapartners-Google/2.1 |
| Mediapartners-Google 2.1 | Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html) |
| Mercator 2.0 | Mercator-2.0 |
| MetaGer-LinkChecker | MetaGer-LinkChecker |
| Metacarta | metacarta (crawler@metacarta.com) |
| Metacarta | metacarta crawler@metacarta.com |
| Microsoft URL Control | Microsoft URL Control - 5.00.3609 |
| Microsoft URL Control | Microsoft URL Control - 5.01.4319 |
| Microsoft URL Control | Microsoft URL Control - 6.00.8169 |
| Microsoft URL Control | Microsoft URL Control - 6.00.8862 |
| Microsoft-ATL-Native 7.00 | Microsoft-ATL-Native/7.00 |
| MicrosoftPrototypeCrawler | MicrosoftPrototypeCrawler (How's my crawling? mailto:newbiecrawler@hotmail.com) |
| Moget 1.0 | moget/1.0 (moget@goo.ne.jp) |
| Moget 2.1 | moget/2.1 (moget@goo.ne.jp) |
| MozDex 0.04 | mozDex/0.04-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com) |
| MozDex 0.05 | mozDex/0.05-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com) |
| Mozilla | Mozilla/4.0 (compatible; Netcraft Web Server Survey) |
| Msnbot 0.1 | MSNBOT/0.1 (http://search.msn.com/msnbot.htm) |
| Msnbot 0.11 | msnbot/0.11 (+http://search.msn.com/msnbot.htm) |
| Msnbot 0.3 | msnbot/0.3 (+http://search.msn.com/msnbot.htm) |
| Msnbot 1.0 | msnbot/1.0 (+http://search.msn.com/msnbot.htm) |
| MysteryBot | Mozilla/3.01 (compatible;) |
| NG 1.0 | NG/1.0 |
| NPBot | NPBot |
| NPBot | NPBot (http://www.nameprotect.com/botinfo.html) |
| NPBot | NPBot-1/2.0 |
| NPBot | NPBot-1/2.0 (http://www.nameprotect.com/botinfo.html) |
| NaverBot 1.0 | NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) |
| NaverBot_dloader 1.5 | NaverBot_dloader/1.5 |
| NaverRobot 1.0 | dloader(NaverRobot)/1.0 |
| NaverRobot 1.5 | dloader(NaverRobot)/1.5 |
| NetAnts 1.25 | NetAnts/1.25 |
| NetNoseCrawler 1.0 | NetNoseCrawler/v1.0 |
| NetNoseCrawler 2.0 | Mozilla/4.0 (compatible; MSIE 5.0; NetNose-Crawler 2.0; A New Search Experience: http://www.netnose.com) |
| NetResearchServer 2.4 | NetResearchServer/2.4(loopimprovements.com/robot.html) |
| NetResearchServer 2.5 | NetResearchServer/2.5(loopimprovements.com/robot.html) |
| NetResearchServer 2.7 | NetResearchServer/2.7(loopimprovements.com/robot.html) |
| NetResearchServer 2.8 | NetResearchServer/2.8(loopimprovements.com/robot.html) |
| NetResearchServer 2.9 | NetResearchServer/2.9(loopimprovements.com/robot.html) |
| NetResearchServer 3.4 | NetResearchServer/3.4(loopimprovements.com/robot.html) |
| NetResearchServer | NetResearchServer(http://www.look.com) |
| NextGenSearchBot 1 | NextGenSearchBot 1 (for information visit http://www.eliyon.com/NextGenSearchBot) |
| None | none |
| NuSearch Spider | NuSearch Spider www.nusearch.com |
| NutchBot 0.05 | NutchCVS/0.05 (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) |
| NutchBot 0.05 | NutchCVS/0.05-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) |
| NutchBot 0.06 | CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) |
| NutchCrawler | Robot: NutchCrawler, Owner: wdavies@acm.org |
| NutchOrg 0.03 | NutchOrg/0.03-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net) |
| OWR_Crawler 0.1 | OWR_Crawler 0.1 |
| Obot | Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot) |
| Obot | oBot |
| Ocelli 1.3 | Ocelli/1.3 (http://www.globalspec.com/Ocelli) |
| OmniExplorer_Bot 1.07 | OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer |
| OmniExplorer_Bot 1.07 | OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Job Crawler |
| Openbot 3.0 | Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html) |
| Openbot 3.0 | Openbot/3.0+(robot@monkia.com.tw;+http://gais.cs.ccu.edu.tw/robot.php) |
| Openbot 3.0 | Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html) |
| OrangeBot | OrangeBot |
| Organica 2.24 | Mozilla/4.0 (compatible; Advanced Email Extractor v2.24) |
| Overture-WebCrawler 3.8 | Overture-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) |
| PEERbot | PEERbot www.peerbot.com |
| PWS.Kiosk | PWS.Kiosk - Content Filtering |
| Parabot | parabot (paracite@ecs.soton.ac.uk) |
| Patwebbot | Patwebbot (http://www.herz-power.de/technik.html) |
| Pavuk 0.9 | pavuk/0.9pl28 i586-pc-cygwin |
| Pavuk 0.9 | pavuk/0.9pl29b i686-pc-linux-gnu |
| PipeLiner 0.3 | pipeLiner/0.3a (PipeLine Spider; http://www.pipeline-search.com/webmaster.html; webmaster@pipeline-search.com) |
| Planethosting | http://www.planethosting.com |
| Polybot 1.0 | polybot 1.0 (http://cis.poly.edu/polybot/) |
| Pompos 1.1 | Pompos/1.1 http://pompos.iliad.fr |
| Pompos 1.2 | Pompos/1.2 http://pompos.iliad.fr |
| Pompos 1.3 | Pompos/1.3 http://dir.com/pompos.html |
| Portal Manager 0.7 | Portal Manager 0.7 |
| Potbot 1.0 | potbot 1.0 |
| ProWebGuide Link Checker | ProWebGuide Link Checker (http://www.prowebguide.com) |
| Program Shareware 1.0.3 | Program Shareware 1.0.3 |
| Psbot 0.1 | psbot/0.1 (+http://www.picsearch.com/bot.html) |
| Pverify 1.2 | pverify/1.2 |
| QPCreep Test Rig | QPCreep Test Rig ( We are not indexing, just testing ) |
| QuepasaCreep 0.9.14 | QuepasaCreep v0.9.14 |
| QuepasaCreep | QuepasaCreep ( crawler@quepasacorp.com ) |
| QuepasaCreep v0.9.13 | QuepasaCreep v0.9.13 |
| RPT-HTTPClient 0.3 | RPT-HTTPClient/0.3-3 |
| Reifier | reifier.org (admin@reifier.org) |
| Reifier | reifier.org admin@reifier.org |
| Rico 0.1 | rico/0.1 |
| RixBot | RixBot (http://www.oops-as.no/rix/) |
| RoboPal | RoboPal (http://www.findpal.com/) |
| RobotMidareru 0.7 | RobotMidareru/0.7libwww-perl/5.65 |
| Robots.txt Validator | Search Engine World Robots.txt Validator at http://www.searchengineworld.com/...i-bin/robotcheck.cgi |
| Robozilla 1.0 | Robozilla/1.0 |
| SYCLIKControl LinkChecker | Mozilla/5.0 (compatible; SYCLIKControl/LinkChecker;) |
| SafariBookmarkChecker 1.25 | SafariBookmarkChecker/1.25 (+http://www.coriolis.ch/) |
| SafariBookmarkChecker 1.26 | SafariBookmarkChecker/1.26 (+http://www.coriolis.ch/) |
| Scooter 1.0 | Scooter/1.0 |
| Scooter 1.1 | Scooter-ARS-1.1 |
| Scooter 3.0 | Scooter-3.0.FS - Altavista.com |
| Scooter 3.2 | Scooter-3.2 |
| Scooter 3.2 | Scooter-3.2.BT |
| Scooter 3.2 | Scooter-3.2.EX |
| Scooter 3.2 | Scooter-3.2.FNR |
| Scooter 3.2 | Scooter-3.2.PDF |
| Scooter 3.2 | Scooter-3.2.SF0 |
| Scooter 3.2 | Scooter-3.2.TX.FNR |
| Scooter 3.2 | Scooter-3.2.XX0 |
| Scooter 3.2 | Scooter/3.2 |
| Scooter 3.2 | Scooter/3.2.SF0 |
| Scooter 3.2 | Scooter_x0-3.2.EX |
| Scooter 3.3 | Scooter/3.3 |
| Scooter 3.3 | Scooter/3.3.QA |
| Scooter 3.3 | Scooter/3.3.QA.pczukor |
| Scooter 3.3 | Scooter/3.3.vscooter |
| Scooter 3.3 | Scooter/3.3_SF |
| Scrubby 2.1 | Scrubby/2.1 (http://www.scrubtheweb.com/abs/meta-check.html) |
| Scrubby 2.2 | Scrubby/2.2 (http://www.scrubtheweb.com/) |
| Search Agent 1.0 | Search Agent 1.0 |
| SearchSpider 1.1 | SearchSpider.com/1.1 |
| Seekbot 1.0 | Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/0.3 |
| Seekbot 1.0 | Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.0 (XDF) |
| Semanticdiscovery 0.1 | semanticdiscovery/0.1 |
| Sensis.au Web Crawler | Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au) |
| Sherlock 1.3 | sherlock/1.3 httpget/1.3 |
| Sherlock_spider | sherlock_spider (jimfan@163.com) |
| SiteXpert | SiteXpert |
| Sitecheck | InternetSeer.com |
| Sitecheck | sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com) |
| Sitescooper 3.1.2 | sitescooper/3.1.2 (http://sitescooper.org) libwww-perl/5.51 |
| SlySearch 1.3 | SlySearch/1.3 (http://www.slysearch.com) |
| SlySearch 1.3 | SlySearch/1.3 http://www.slysearch.com |
| Sohu-search | sohu-search |
| Speedy Spider | Speedy Spider (http://www.entireweb.com) |
| SpeedySpider | Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com) |
| Speedy_Spider | Speedy_Spider_(http://www.entireweb.com) |
| SpiderKU 0.9 | SpiderKU/0.9 |
| SpiderMonkey 7.04 | SpiderMonkey/7.04 (SpiderMonkey.ca info at http://spidermonkey.ca/sm.shtml) |
| SpiderMonkey 7.06 | Spider_Monkey/7.06 (SpiderMonkey.ca info at http://SpiderMonkey.ca /sm.shtml) |
| SpiderMonkey 7.06 | Spider_Monkey/7.06 (SpiderMonkey.ca info at http://www.spidermonkey.ca/sm.shtml) |
| SpurlBot 0.2 | Mozilla/5.0 (compatible; SpurlBot/0.2) |
| Sqworm 2.9.85 | Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux-gnu) |
| Star Downloader | Star Downloader |
| Steeler 1.3 | Steeler/1.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
| SuperCleaner 2.56 | Mozilla/4.0 (compatible; SuperCleaner 2.56; Windows NT 5.1) |
| Szukacz 1.5 | Szukacz/1.5 |
| Szukacz 1.5 | Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html; info@szukacz.pl) |
| Tarantula | Tarantula Experimental Crawler |
| TclSOAP 1.0 | Tcl http client package 1.0 |
| TclSOAP 2.3 | Tcl http client package 2.3 |
| Teradex Mapper | (Teradex Mapper; mapper@teradex.com; http://www.teradex.com) |
| Teradex_Crawler | Teradex_Crawler (crawler@teradex.com; http://crawler.teradex.com) |
| TheSuBot 0.1 | TheSuBot/0.1 (www.thesubot.de) |
| TheSuBot Beta | thesubot-beta-www.thesubot.de |
| Thumbshots-de-Bot | thumbshots-de-Bot (Version: 1.02, powered by www.thumbshots.de) |
| TimboBot 0.9 | timboBot/0.9 http://www.breakingblogs.com/timbo_bot.html |
| Tkensaku 0.9 | Tkensaku/0.9 (http://www.tkensaku.com/q.html) |
| TranSGeniKBot | TranSGeniKBot (http://www.tsgk.net) |
| TranSGeniKBot www.tsgk.net | TranSGeniKBot http://www.tsgk.net |
| TulipChain 5.7 | TulipChain/5.7 (http://ostermiller.org/tulipchain/) Java/1.4.0_02 (http://java.sun.com/) Windows_Me/4.90 |
| TulipChain 5.94 | TulipChain/5.94 (http://ostermiller.org/tulipchain/) Java/1.4.1_01 (http://apple.com/) Mac_OS_X/10.2.8 |
| TulipChain 6.01 | TulipChain/6.01 (http://ostermiller.org/tulipchain/) Java/1.4.2_03 (http://java.sun.com/) Windows_XP/5.1 RPT-HTTPClient/0.3-3 |
| TulipChain 6.02 | TulipChain/6.02 (http://ostermiller.org/tulipchain/) Java/1.4.2_03 (http://apple.com/) Mac_OS_X/10.3.3 RPT-HTTPClient/0.3-3 |
| TulipChain 6.03 | TulipChain/6.03 (http://ostermiller.org/tulipchain/) Java/1.4.2_05 (http://java.sun.com/) Windows_XP/5.1 RPT-HTTPClient/0.3-3 |
| TurnitinBot 1.4 | TurnitinBot/1.4 (http://www.turnitin.com/robot/crawlerinfo.html) |
| TurnitinBot 1.4 | TurnitinBot/1.4 http://www.turnitin.com/...bot/crawlerinfo.html |
| TurnitinBot 1.5 | TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html) |
| TurnitinBot 1.5 | TurnitinBot/1.5 http://www.turnitin.com/...bot/crawlerinfo.html |
| TurnitinBot 2.0 | TurnitinBot/2.0 (http://www.turnitin.com/robot/crawlerinfo.html) |
| TurnitinBot 2.0 | TurnitinBot/2.0 http://www.turnitin.com/...bot/crawlerinfo.html |
| TutorGigBot 1.5 | TutorGigBot/1.5 ( +http://www.tutorgig.info ) |
| Tutorial Crawler 1.4 | Tutorial Crawler 1.4 (http://www.tutorgig.com/crawler) |
| UIowaCrawler 1.0 | UIowaCrawler/1.0 |
| UIowaCrawler 2.0 | UIowaCrawler/2.0 |
| USyd-NLP-Spider | USyd-NLP-Spider (http://www.it.usyd.edu.au/~vinci/bot.html) |
| UdmSearch 3.1.20 | UdmSearch/3.1.20 |
| Unchaos_crawler 2.0.2 | unchaos_crawler_2.0.2 (search.engine@unchaos.com) |
| Updated 0.1 | updated/0.1beta (updated.com; http://www.updated.com; crawler@updated.om) |
| VSE 1.0 | VSE/1.0 (vsecrawler@hotmail.com) |
| Vagabondo 2.0 | Vagabondo/2.0 MT (webagent at wise-guys dot nl) |
| Vagabondo 2.0 | Vagabondo/2.0 MT (webagent@NOSPAMwise-guys.nl) |
| Vagabondo 2.1 | Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/) |
| Vivante Link Checker | Vivante Link Checker (http://www.vivante.com) |
| Void-bot 0.1 | void-bot/0.1 (bot@void.be; http://www.void.be/) |
| VoilaBot 1.6 | Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot; 1.6 |
| VoilaBot 1.6 | Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_VoilaBot/1.6 libwww/5.3.2 |
| Vspider | vspider |
| W3C-checklink 2.90 | W3C-checklink/2.90 libwww-perl/5.64 |
| W3C-checklink 3.6.2.3 | W3C-checklink/3.6.2.3 libwww-perl/5.64 |
| W3C-checklink 3.9.2 | W3C-checklink/3.9.2 [3.17] libwww-perl/5.79 |
| W3C-checklink 4.0 | W3C-checklink/4.0 [4.4] libwww-perl/5.800 |
| W3C-checklink 4.1 | W3C-checklink/4.1 [4.14] libwww-perl/5.800 |
| W3C_Validator 1.183 | W3C_Validator/1.183 libwww-perl/5.64 |
| W3C_Validator 1.305.2.109 | W3C_Validator/1.305.2.109 libwww-perl/5.79 |
| W3C_Validator 1.305.2.12 | W3C_Validator/1.305.2.12 libwww-perl/5.64 |
| W3C_Validator 1.305.2.137 | W3C_Validator/1.305.2.137 libwww-perl/
|