User-agent: Fasterfox Disallow: / User-agent: * Disallow: /cgi-bin/* Disallow: /assets/* Disallow: /images/* Disallow: /admin/* Disallow: /admin Disallow: /cp/* Disallow: /xt/* Disallow: /agency/* Disallow: /bottrap Disallow: /bottrap/* Disallow: /freecourse Disallow: /freecourse/*