User-agent: * Disallow: /admin/ Disallow: /articles/ Disallow: /engine/ Disallow: /media/ Disallow: /templates/