#Partybox.co.uk - Robots.txt file - Updated Kevin Wolstenholme 16-12-05 - Line 12 #Partybox.co.uk - Robots.txt file - Updated Chris Tree 17-01-06 - Disallow Uni students Theophrastus spider to reduce load #Partybox.co.uk - Robots.txt file - Updated Chris Tree 13-03-06 - Disallow Sensis spider to reduce load User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /fpdb/ Disallow: /css/ Disallow: /orderfiles/ Disallow: /db/ Disallow: /vt_auth/ Disallow: /affiliatewindows/ Disallow: /livestaging/ User-agent: msnbot Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: / User-agent: Theophrastus Disallow: / User-agent: Sensis Disallow: / User-agent: Sensis Web Crawler Disallow: / User-agent: Gigabot Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: ichiro Disallow: / User-agent: ia_archiver Disallow: / User-agent: empas Disallow: / User-agent: Voila Disallow: / User-agent: SBIder Disallow: / # End robots.txt file