# Allow Archiver
User-agent: ia_archiver
Allow: /

User-agent: *

Disallow: *.js
Disallow: *.jsp
Disallow: *.cfm
Disallow: *.asp
Disallow: *.aspx
Disallow: *.cgi

Disallow: /forum/includes/
Disallow: /forum/install/
Disallow: /forum/customavatars/
Disallow: /forum/archive/
Disallow: /forum/sitemap/
Disallow: /forum/customavatars/
Disallow: /forum/customprofilepics/
Disallow: /forum/includes/
Disallow: /forum/install/
Disallow: /forum/members/


Sitemap: http://www.transformers.com.my/forum/sitemap_index.xml.gz