User-agent: Mozilla/3.0 (compatible;miner;mailto:miner@miner.com.br) Disallow: / User-agent: WebFerret Disallow: / User-agent: Due to a deficiency in Java it's not currently possible to set the User-agent. Disallow: / User-agent: no Disallow: / User-agent: 'Ahoy! The Homepage Finder' Disallow: / User-agent: Arachnophilia Disallow: / User-agent: ArchitextSpider Disallow: / User-agent: ASpider/0.09 Disallow: / User-agent: AURESYS/1.0 Disallow: / User-agent: BackRub/*.* Disallow: / User-agent: Big Brother Disallow: / User-agent: BlackWidow Disallow: / User-agent: BSpider/1.0 libwww-perl/0.40 Disallow: / User-agent: CACTVS Chemistry Spider Disallow: / User-agent: Digimarc CGIReader/1.0 Disallow: / User-agent: Checkbot/x.xx LWP/5.x Disallow: / User-agent: CMC/0.01 Disallow: / User-agent: combine/0.0 Disallow: / User-agent: conceptbot/0.3 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: root/0.1 Disallow: / User-agent: CS-HKUST-IndexServer/1.0 Disallow: / User-agent: CyberSpyder/2.1 Disallow: / User-agent: Deweb/1.01 Disallow: / User-agent: DragonBot/1.0 libwww/5.0 Disallow: / User-agent: EIT-Link-Verifier-Robot/0.2 Disallow: / User-agent: Emacs-w3/v[0-9\.]+ Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EMC Spider Disallow: / User-agent: explorersearch Disallow: / User-agent: Explorer Disallow: / User-agent: ExtractorPro Disallow: / User-agent: FelixIDE/1.0 Disallow: / User-agent: Hazel's Ferret Web hopper, Disallow: / User-agent: ESIRover v1.0 Disallow: / User-agent: fido/0.9 Harvest/1.4.pl2 Disallow: / User-agent: Hämähäkki/0.2 Disallow: / User-agent: KIT-Fireball/2.0 libwww/5.0a Disallow: / User-agent: Fish-Search-Robot Disallow: / User-agent: Mozilla/2.0 (compatible fouineur v2.0; fouineur.9bit.qc.ca) Disallow: / User-agent: Robot du CRIM 1.0a Disallow: / User-agent: Freecrawl Disallow: / User-agent: FunnelWeb-1.0 Disallow: / User-agent: gcreep/1.0 Disallow: / User-agent: ??? Disallow: / User-agent: GetURL.rexx v1.05 Disallow: / User-agent: Golem/1.1 Disallow: / User-agent: Gromit/1.0 Disallow: / User-agent: Gulliver/1.1 Disallow: / User-agent: yes Disallow: / User-agent: AITCSRobot/1.1 Disallow: / User-agent: * Allow: / Disallow: /wp-admin/ Sitemap: http://www.sandun.lk/sitemap.xml Sitemap: http://www.sandun.lk/sitemap.xml.gz