Support Forum

sp_Search Search
Advanced Search
Advanced Search
Forum Scope


Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
general-topic
Google is indexing all of the pages of the forum what..
Avatar
sluxent
Rookie
Free Members
sp_UserOfflineSmall Offline
Go to Top
Mar 8, 2012 - 3:33 pm

Google is indexing all of the pages of the forum what like:

 

Index of /wp-content/plugins/simple-forum/resources

  • Parent Directory
  • css/
  • images/
  • jscript/

what do I do how do I disable that?

Avatar
Mr Papa
Simi Valley, CA
SP Master
Free Members
sp_UserOfflineSmall Offline
sp_UserWebsite sp_Twitter sp_Facebook sp_GooglePlus
Go to Top
Mar 8, 2012 - 8:54 pm

you need a robots.txt file to control where bots can go...   you shouldnt be letting them crawl any of the non content urls...  google WordPress and robots.txt and you will find lots of suggestions for robots.txt and plugins that do it too...

sp_Feed All RSS
Go to top
Forum Timezone: Europe/Stockholm
Most Users Ever Online: 1170
Currently Online:
Guest(s) 1
Currently Browsing this Page:
1 Guest(s)
Top Posters:
Mr Papa: 19448
Ike: 2086
Brandon: 864
kvr28: 804
jim: 650
FidoSysop: 577
Conrad_Farlow: 531
fiddlerman: 358
Stefano Prete: 325
Member Stats:
Guest Posters: 620
Members: 17365
Moderators: 0
Admins: 4
Forum Stats:
Groups: 7
Forums: 17
Topics: 10128
Posts: 79626