Support Forum

Google is indexing all of the pages of the forum what..

SL sluxent
sluxent
Member
Member since Jan 2012
1 post
Mar 8, 2012 · 3:33 pm · Edited

Google is indexing all of the pages of the forum what like:

 

Index of /wp-content/plugins/simple-forum/resources

  • Parent Directory
  • css/
  • images/
  • jscript/

what do I do how do I disable that?

1 Answer

New Answer
MP Mr Papa
Mr Papa
Member
Member since Dec 2006
19,448 posts
Mar 8, 2012 · 8:54 pm

you need a robots.txt file to control where bots can go…   you shouldnt be letting them crawl any of the non content urls…  google WordPress and robots.txt and you will find lots of suggestions for robots.txt and plugins that do it too…