http://www.yoursite.com/robots.txt
http://example.yoursite.com/robots.txt
http://www.yoursite.com/community/robots.txt هذا مثال خاطئ
http://example.yoursite.com/forum/robots.txt هذا مثال خاطئ
User-agent: * Disallow: /find-new/ Disallow: /account/ Disallow: /attachments/ Disallow: /goto/ Disallow: /posts/ Disallow: /login/ Disallow: /admin.php Disallow: /conversations/ Disallow: /members/ Disallow: /logout/ Disallow: /lost-password/ Disallow: /misc/style/ Disallow: /js Allow: /
Disallow: /members/
User-agent: * Disallow: /community/find-new/ Disallow: /community/account/ Disallow: /community/attachments/ Disallow: /community/goto/ Disallow: /community/posts/ Disallow: /community/login/ Disallow: /community/admin.php Disallow: /community/conversations/ Disallow: /community/members/ Disallow: /community/logout/ Disallow: /community/lost-password/ Disallow: /community/misc/style/ Disallow: /community/js Allow: /