Support Forum

Google webmaster tools throws crawl errors for SP

4 Answers

New Answer

YS Yellow Swordfish
Yellow Swordfish
Member

I am no expert on GA and the webmaster tools but I suppose the first questions should be about the urls themselves. Are they, in fact, genuine? Were they once genuine but have since been deleted? Are they all, in fact, bogus? There must be something common about them surely…

MP Mr Papa
Mr Papa
Member

if they are real, are they protected?  ie part of a private forum?

SH Shama
Shama
Member

I checked a bunch of them and it seems that many are pages or posts that once existed, but were subsequently deleted. I am not sure how google still sees them as existing.

There are urls like these:

wp-content/plugins/simple-forum/editors/tinymce/plugins/inlinepopups/skins/clearlooks2/img/

wp-content/plugins/simple-forum/admin/panel-tags/support/page/2/

wp-content/plugins/simple-forum/admin/panel-admins/

wp-content/plugins/simple-forum/editors/tinymce/themes/advanced/source_editor.htm

They must be part of the internal SP structure since they were certainly not created or deleted by me.

MP Mr Papa
Mr Papa
Member

seems to me like you are allowing google to crawl your wp-content directory… you need a robots.txt and tell google to stay out of there…