Support Forum

Advanced Search
Forum Scope


Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
general-topic
'Clean up post count' housekeeping on big databases? Not good.
Avatar
Chuck Smith
Rookie
Free Members
sp_UserOfflineSmall Offline
Jan 27, 2015 - 11:02 am

Using latest rev of Simple:Press. 

Got a pretty big database.  The wp_sfposts table has 594,374 rows and is 279 MB.

Somehow the post counts have gotten screwed up.  Went into the Simple:Press housekeeping and told it to Clean Up the Post Counts.  After about 90 minutes of watching 'please wait' it breaks something and when you try to log into the Wordpress site it says it can't establish a link to the database.  I have to contact my host provider and they do some sort of database rebuild to get things back to normal... but my Simple:Press post counts are still way off. 

Tried disabling all Wordpress plugins except Simple:Press.  Did the post count housekeeping again.  Same result.  Disabled all Simple:Press plugins.  Same results. 

I'm stumped.  Any suggestions?

Avatar
Yellow Swordfish
Glinton, England
SP Master
sp_UserOfflineSmall Offline
Jan 27, 2015 - 12:26 pm

Wow. Big numbers. Might be useful to know the number of members/users as well.

This task is always going to be a bit of a major DB hit so it might be that we just need a way to batch it up into smaller chunks.

Would you be willing and able to ask your host support what the problem they found was exactly and what they did to correct it? And perhaps while at it you could ask them if you database needs optimising.

It might be useful to know what got stuck so we can plan a way out of it.

andy-signature.png
YELLOW
SWORDFISH
Avatar
Chuck Smith
Rookie
Free Members
sp_UserOfflineSmall Offline
Jan 27, 2015 - 1:44 pm

18,411 members/users

The host ended up rolling the site back a couple of days to when things were working.  Not much help in identifying the problem.

I tried optimizing the tables with phpMyAdmin.  No difference in the end result... still led to a lockup.

Is there another way to do the post count cleanup rather than on this live system?  Pretty sure my host is starting to think of me as a high maintenance customer... meaning my days are numbered. 

Avatar
Yellow Swordfish
Glinton, England
SP Master
sp_UserOfflineSmall Offline
Jan 27, 2015 - 3:29 pm

Rolling back? That's most unhelpful and somewhat careless of them. I guess just easier than actually tracing the problem. It is actually hard to see, on what is such a simple query update, what could go wrong short of a timeout condition. And i can come up with no reasonable explanation as to why that should corrupt anything at all.

Would you be happy to execute update queries on your database via phpMyAdmin?

andy-signature.png
YELLOW
SWORDFISH
Forum Timezone: Europe/Stockholm
Most Users Ever Online: 1170
Currently Online:
Guest(s) 1
Currently Browsing this Page:
1 Guest(s)
Top Posters:
Mr Papa: 19448
Ike: 2086
Brandon: 864
kvr28: 804
jim: 650
FidoSysop: 577
Conrad_Farlow: 531
fiddlerman: 358
Stefano Prete: 325
Member Stats:
Guest Posters: 620
Members: 17365
Moderators: 0
Admins: 4
Forum Stats:
Groups: 7
Forums: 17
Topics: 10128
Posts: 79626