User-agent: * Allow:/ Disallow: /admin Disallow: /cms Disallow: /css Disallow: /html Disallow: /include Disallow: /js