Support Forum

Performance Problem loading Forum

HA Hari
Hari
Member

I am starting to build the structure of the new forum, and although I still have zero Threads and zero Load on the Forum, I have a major problem issue, that makes me wonder, weather this Forum is usable.

Let me explain.

(1) The technical Setup

I am on a dedicated server, not a big one, but all performance monitors show a decent performance and the server is far from being on the edge. There is still plenty of headroom in CPU Load, Memory, I/O etc. Data from Google Pagespeed shows a good performance too. So the server and the infrastructure seems not to be the issue here.

Also, the issue is not browser dependend. I testet several browser from Mozilla, over Edge to Chrome and all show similar performance characteristics with simple:press as described below.

As of now, I am not using a caching plugin for wordpress, as this was unnecessary until now and I prefer raw server power instead of caching. If the server would be the bottleneck, I would simply enhance its hardware. But the server seems OK and is idle most of the time.

Also I have the checkmarks in your options set for combining and caching CSS as well as for Script (JS). Error logging is disabled too.

I loud about 12 plugins from your library. But I tested without the plugins and although a small positive effect is there, the major performance issue still exists even without any plugin activated.

(2) Mingle Reference Performance

At the moment I run Mingle Forum with currently 2.300 Threads, 25.000 Posts.

Loading the complete Mingle Forum Structure on the top level page with all Groups and Forums, costs around 20 seconds from an end user perspective. That is a lot, but in this case acceptable.

Loading a single Mingle forum within the structure, costs around 5 seconds. It could be better, but this is acceptable too. Dont forget, this is during “Live” loadtime – users are accessing the Mingle Forum in parallel.

So thats the reference for simple:press. If simple:press could give me a similar performance under load, it would be OK.

(3) The major Performance Issue

Now I am building my Group and Forum structure in simple:press and have 6 Groups and 40 Forums.

And I have still zero Threads and Posts and no load at all on the forum itself.

Loadtime for the top forum structure is more than 30 seconds. Inacceptable.

Loadtime of a singe forum (zero thread) is about 15 seconds. Completely inacceptable. This renders the forum unusable.

I dont want to guess, what load would mean to this performance. Something seems terribly wrong.

I see for example your forum here and although it is not super fast, it is OK for me. Nothing compared to what I experience.

(4) Question and Advice

I am well aware, that performance is a delicate thing with many interdependencies and there will be no easy fix.

But this behaviour seems to hint to a general problem. Tweeking 20% out of the system by whatever means would be nice, but would not adress the major problem.

Or in other words, if the time to access a single forum or thread goes down from 15 to 12 seconds, it would be still unusable. 5 seconds and lower is something, that can be accepted from a user perspective, although it is still not fast.

What I need is advice where to look. Somewhere must be a major bottleneck and as the server and the web infrastructure shows no sign of stress and all other services (wordpress, Mingle etc) run without any performance problems, the bottleneck seems to either be within simple:press or maybe the result of some strange interdependency.

What can I do, to reach an acceptable performance? The current status is unfortunately nothing, I could show my customers, this would make them mad.

Thanks in advance.

Hari

32 Answers

New Answer

MP Mr Papa
Mr Papa
Member

first, agree caching is not needed and in fact, unless a custom instantiation will not work with the forum – its content is dynamic (all content appears on single wp page) and would need to be disabled for the forum page… which is why we do are own internal caching…

but not much info here… which page views?  group, forum, etc?  the more you display on a single page, the more resources needed… for example, if on topic view, you show 100 posts per page, it will be slower than if you showed 10…  you have 40 forums which is a large number… shouldnt be a big issue on decent server (just about any dedicated would qualify), but worth an investigation if your slow down is on group view (is that what you mean by top forum structure?)…

are you using any of our plugins?  or template tags in sidebar (such as recent posts)???

do you get same if you temp disable Mingle?  we had one user report odd slow downs with both active (though many others did not)…

have you run tests with other wp plugins disabled?  normal expectation would be no difference, but its a data point..

on group view, how many db queries are you seeing?  are any of them ‘slow’ by mysql?  if you dont know how to look at this, would suggest the wonderful wp debug bar plugin with some of the add on plugins (debug bar extender, debug bar slow actions or debug bar query tracer for example)…

are you seeing any needless page redirects going on (live http headers or similar for firefox helps)?  any particular http requests taking inordinate amount of time?

what are you doing with avatars and simple press?  forum – profiles – avatars…  what is the priority order? and are you replacing wp avatars?  just want to make sure not some sort of looping going on…

its not a general problem for users – we have some users with well over a million posts and routinely have hundreds of users on the site at same time..  we have large number of users running simple press on horrible shared hosting…

with some data, should be possible to figure out what is going on…

HA Hari
Hari
Member

MrPapa,

thanks, but most of your questions are already answered within my careful created and structured post. Would be nice, if you could read that again.

For example:

ZERO POSTS – forums not under load yet. I am in the construction phase. Just the (empty) structure of 40 forums and 6 groups.

12 Plugins, but performance issue exists without any of them too.

No current load by users – instead of myself. 😉

No Avatars used yet, individual loaded avatars as first option, then standard sp avatars. Should be no problem.

Disabling Mingle is not an option, as I will not migrate the content, but will offer the old mingle forum as archive with read only.

DB queries not checked yet, but as all other services including mingle show no problem, this seems not probable as cause.

Any concrete hints and ideas after fully rereading my post?

Thanks

PS:

I deactivated the mingle recent post widget, that had the interdependency with your recent post widget.

So as a test case:

No recent post widgets of neither mingle nor SP.

The result, loading the main structure of the SP forum – again with ZERO POSTS and ZERO LOAD is:

42 seconds!

Also I still see no other load issue anywhere beside simple:press. Everything runs smooth from wordpress to mingle, just 42 seconds for an empty SP forum structure.

Something seems very wrong and I have no idea, what it could be….

 

PPS:

Tried “WP Debug Bar” plus “Debug Bar Slow Actions” as you proposed. Set WP Debug Mode to True.

Result when accessing SP Main Structure is “500 Internal Server Error” after more than 60 seconds of wait time. The plugin is not updated since more than 1 year so it doesnt make a lot of sense to spend time in chasing the cause here.

After going back to Debug Mode = False and deactivating the Plugin, the timeframe for loading SP main structure was back to roughly 40 seconds as before.

Something seems very wrong and I have no idea, what it could be….

HA Hari
Hari
Member

PPPS:

Tested on test installation without ANY load and ANY posts at all. An empty installation, just with the identical setup as the live installation.

Calling SP in Debug mode shows:

  1. NOTICE: wp-content/plugins/simple-press/sp-startup/forum/sp-forum-support-functions.php:700 – Undefined index: sfseo_og
    require(‘wp-blog-header.php’), require_once(‘wp-includes/template-loader.php’), include(‘/themes/generatepress/page.php’), get_header, locate_template, load_template, require_once(‘/themes/generatepress/header.php’), language_attributes, get_language_attributes, apply_filters(‘language_attributes’), call_user_func_array, sp_og_namespace
  2. NOTICE: wp-content/plugins/simple-press/sp-startup/forum/sp-forum-support-functions.php:715 – Undefined index: sfseo_og
    require(‘wp-blog-header.php’), require_once(‘wp-includes/template-loader.php’), include(‘/themes/generatepress/page.php’), get_header, locate_template, load_template, require_once(‘/themes/generatepress/header.php’), wp_head, do_action(‘wp_head’), call_user_func_array, sp_og_meta
  3. NOTICE: wp-content/plugins/simple-press/forum/content/classes/sp-group-view-class.php:473 – Undefined variable: s
    require(‘wp-blog-header.php’), require_once(‘wp-includes/template-loader.php’), include(‘/themes/generatepress/page.php’), get_template_part, locate_template, load_template, require(‘/themes/generatepress/content-page.php’), the_content, apply_filters(‘the_content’), call_user_func_array, sp_render_forum, sp_process_template, sp_load_template, include(‘/sp-resources/forum-themes/default/templates/spGroupView.php’), sp_has_groups, spGroupView->__construct, spGroupView->sp_groupview_query

It is not 100% clear, weather this is 100% identical to the Live system, as SP runs into an 500 internal server error in debug mode there.

Just of notice: the fixes for /admin/panel-profiles/forms/spa-profiles-options-form.php are applied.

Now every bullet of your list is applied, concrete advice needed.

HA Hari
Hari
Member

PPPPS:

it starts to get frustrating.

Within 2 additional hours of work, I deactivated almost any plugin and widget and tried again.

All the major plugins used have been deactivated including Mingle and S2 Members, but the problem persists.

Loading SP with an empty structure of empty forum now needs 50+ seconds. Ridiculous.

Everything else is working perfectly fine. The server is fine without any bottleneck.

I am lost. Obviously I need more from you, than just a quick scan of 50% of what I have written.

I am fully aware, that it is not your job to debug my installation, its mine.

But what I need from you, are more concret hints and ideas what to debug in SP and where to look.

Everything I see hints to SP itself as the cause.

KV kvr28
kvr28
Member

As someone that used mingle and converted to SP I would recommend disabling mingle and checking the performance. If it fixes it like the recent post widget issue and you want to keep the mingle forum as an archive I would do a full import from mingle to simple press and create a archive forum and then create a sub-forum structure under archives that mimics your mingle forum, then migrate all the threads from the main forum structure to the sub forums under archives. You can use redirects to fix any links to the mingle forum that may be floating out there

One other question that I haven’t seen asked, have you tried using one of the default wp themes instead of generatepress? I installed it on my staging server and tested and didn’t see a noticeable impact on speed but it may be worth ruling out.

If you do decide to do the import into an archives forum let me know and I can share the redirect rules we have set up, they may need to be tweaked a little but should be easy to figure out.

HA Hari
Hari
Member

Thxs kvr28, I appreciate your advice. But I completly deactivated Mingle during the last 2 hours as a test, with no effect on the performance issue.

No, I didnt change GeneratePress. This is simple not possible, as it was a long search, kissing many frogs, to finally find a capable theme fitting my needs. And I have a business based on this, this is nothing I simply change. Before I move away from Generate Press, I will dump SP again.

But I am not willing to think that final option yet. Its far too early for that, and I have invested too much time in SP already, to move away easily. And I still like SP, if it works ….The SP guys have not really tried to address my problem yet, but I very much hope they will.

The performance with an empty! forum is so bad (40-50 seconds on a dedicated server mostly idle) that there must be a concrete loop/bootleneck somewhere causing this. This cant be the true SP performance, otherwise SP would have no customers. 😉

Such a replicable bootleneck, should be far more easy to find, than problems that occur erratic without system.

But in order to do that I need help and hints, where possible causes in SP may exist and how to debug them. 

MP Mr Papa
Mr Papa
Member

please keep in mind that its a holiday weekend so we are a bit scarce for next couple days… but will be back later tonight to try to answer some of this…

KV kvr28
kvr28
Member

Who do you use for hosting if you don’t mind me asking? I had some issues with hostgator and godaddy and since switching to a different managed hosting solution it’s been pretty much flawless.

HA Hari
Hari
Member

Sure MrPapa, I am aware of that and I am “Papa” (daddy in german) myself 😉 and family is important. No need for apologies and I dont expect 24 hour weekend service for roughly 100 bucks. 😉

So I dont expect anything over the weekend. If you are able to look into, I appreciate that highly, but  if not, its fine too for me.

But beginning of next week, please try to work with me step by step, until we find this *&%$§* bottleneck.

Thanks

HA Hari
Hari
Member

kvr28, host is in germany (I dont expect you know them) and is no problem. As described in detail in my first post, performance, stability, server, load, everything on the hosting side looks perfectly normal and as every other aspect of my live installation runs flawlessly and with good performance under normal user load, there is no rational need, to further invest in search in that area.

Everything in my long experience is telling me, here is something blocking something on the software side and causing a loop or long wait cycles during build up of the forum structure. It should be able to debug this in SP itself, if someone tells me how to best do this.

EK Edward Koon
Edward Koon
Member

I have ran simple press for several years so i am pretty familiar with it.

My sites DNS is run through CloudFlare that caches and greatly improves load time with their RocketLoader. and one site is pretty large and gets tons of traffic and sp works flawlessly (other than a user reg issue) that has me stumped at the moment. frown

My two cents worth is pointing the finger at your webhost. Some just plain suck! I used to use HostGator but it turned into a joke after EIG bought it. Dedicated server sounds like overkill to me. Maybe check out vultr.com and get a vps instance. You can get a 4cpu with 8192mem for $64 month.

Steve / Andy hope I’m not breaking a forum rule by suggesting another host. Just trying to be helpful.

Regards, Ed

IK Ike
Ike
Member

I’m not sure what could really be ‘debugged’ within SP, may have to wait for Andy or Steve to offer input there but in the meantime what others have said is accurate. There is no reason SP especially a fresh install with no real content should load slowly other than the obvious – hosting. 

However not wanting to beat that drum to death, what happens when you disable SP? Does the slowness continue? It might be worth checking a couple of quick things, check the SP error log in the toolbox for errors (not notices) and check the PHP error log. If you’ve been working with PHP, have been running anything outdated or have installed something that was defective even after removing it’s possible you could have a very full PHP error log which can bring your site to a crawl.

Other that that, do you see anything odd when loading the page if your browser displays URLs of what’s being loaded at the bottom?

Lastly, do you have a local copy of this install? If so – if nothing’s changed and it loads fast locally then likely an external factor is causing the slowness live.

HA Hari
Hari
Member

Folks, I really appreciate you trying to help, especially over the weekend. So I really dont want to be rude, but unfortunately this is not of much help. This type of wild guesses, without taking the time to read, what I already said in detail, only increase my frustration, because I am forced to repeat, what I have already written.

I understand that it needs time to read all, what I have written already, but it is necessary if you truly wish to help.

See it from my perspective:

If I dont write enough and dont give enough detail, you tell me, there is not enough information.

If I adress every piece already – as I more or less tried, you dont read it, because its too much.

Now you please tell me, what shall I do? Hmm? 😉

What I am looking for, is a professional support, that works with me step by step. I dont expect that you solve my problem, it is mine, as long there is no identified issue in SP itself. But I need professional guidance from the SP side, to nail this down.

So let me make this straight. General assumptions and guesses about hosting do not help. I can do them myself, I am well capable of that. What I need, is concrete, qualified input. Concrete hints where to look.

For you, I will sum all this up again below.

Please read the following in full now. Step by step. This sums up everything.

If after that, one of you has a concrete, qualified, professional hunch, what might be going on here, I can guarantee my full attention and gratitude!

1. SP shows a dismal perfomance, when trying to call the main page with forum (eg loading the forum structure needs 40-50 seconds). The dismal performance not only happens when loading the complete structure (all groups and forum), but also loading a single forum too (15 seconds).

2. SP was freshly installed on a running WP System with Mingle, S2 Members and other plugins. PHP is 5.4. Dedicated Apache Server. mySQL 5.1.

3. As of yet, SP consists of 6 groups and 40 forums which are ALL EMPTY in terms of threads. This is the starting forum structure I created in advance, before I present the forums to the community.

To repeat it: there is NO LOAD, NO THREADS, NO CONTENT. An empty SP installation not accessed by users yet – instead of myself.

4. I fully understand, that this behaviour is “not normal” to SP. I am far from saying, this is general SP performance. And I dont blame SP as a cause yet.

But “something” is very wrong here. I know that myself. All I am seeking, is professional help, to identify the cause.

5. NO, the backbone (hosting, server) is NOT THE PROBLEM. Your stories about personal experiences with hosters are nice and I can add some myself from my last 25 years of experience in that business, but they dont add to a solution. Fact is: THE SERVER IS NO ISSUE.

I am fully capable myself of checking its logs and monitoring its load. Everything is fine. The server is idle most of the time and does never ever peak to its limits.

6. The connection between the server (hoster) and the web is also fine. Any other application – ANY – from wordpress to other load – is running within expectations and is showing NO signs of performance degradation.

7. Within the WP installation itself, everything runs fine too! If I  try to load an empty! SP, it needs 40-50 seconds. But a second later, if I try to load Mingle with all its load and content or any other part of my wordpress installation, everything is OK performancewise and works as expected!

So what ever the problem is, it ONLY shows when SP loads its structure. Please recognize the major difference: it dont say SP is the cause. I say: it only shows, when SP loads!

8. So there is no slowness that might go away when I disable SP. The slowness iexists ONLY, when SP loads its structure!

The admin options of SP behave perfectly performance wise. When I am within a thread and using the SP editor, everything is perfectly fine. And so on.

BUT WHENEVER SP LOADS ITS STRUCTURE (groups, forum, etc) the performance there seems to be in a “loop” and nothing happens for a long time. This points a little bit to the database as cause as far as I see this.

9: What did I try already?

9.1. I disabled step by step every plugin used, including Mingle, S2 Members, Security you name it: NO EFFECT.

9.2. I installed the debug tool, that Mr. Papa mentionend. In WP Debug Mode the Server ran into an 500 internal server error when loading SP. Dont ask me why – maybe timeout . All other parts of WP work perfectly even in debug mode. This debug tool is not updated for more than one year, and compatibility to current WP is in question. So it makes no sense to invest too much in searching for the cause of this 500.

9.3. I disabled every of the 12 SP Plugins I use (beside Theme reboot) with NO EFFECT on the general issue.

9.4. I played with most of the options in the SP admin panel but found nothing, that affected the performance issue.

9.5. I checked HTML calls and relinks but there is nothing of reference that could cause this, as I disabled almost anything in SP Options that could cause an outbound link – for example Avatars are either individuell uploaded or SP standard, no gravatars.

Simple: I am lost after hours and hours of work.

Where does this leave me?

Maybe the last step before dumping SP is a complete reinstall. But I want to do this only as the last option, because I already spent hours customizing SP in building the new structure with all rights and groups and forums and giving them good, user friendly descriptions, so that the community immediately knows  what to do.

Some theories on what might happen from my experience:

(1) A strange sideeffect/incompatibility with another part of the installation. I hope this is not the case, because after deactivating every other plugin, I am out of options here.

(2) A database inconsistency or type of locking in SQL caused by whatever. This sounds more reasonable, as this behaviour is related to loading the SP structure only! I ran an optimization of the SQL database with a tool, but with no effect on performance.

(3) Some strange parameter on the server I cant monitor myself easily, for example some memory area that is too small or something like that. Not probable but possible. I would need hints here, where to look. Is there a special area, where SP has a known strain on servers?

(4) An inconsistency to PHP 5.4 oder any other basic part of my installation. Not probable, but possible.

All this are just shots in the dark. As I said, I am lost and if I am forced to completely redo all the customization I already did, I am in the mood to throw SP out of the window. 😉

What do I want from support – from you?

First – hearing ANY professional hunch AFTER reading all my bullets above. I am open to ANY idea, I just dont want to repeat over and over again, what I already said.

Second – an explanation how to debug this “40 seconds” optimaly. I am looking for a tool, with that I idealy could execute SP Step by Step and identify, where the time of the 40 seconds is spent.

SOMEWHERE in this 40 seconds of loading the SP structure, must be a loop or a hangup or a deadlock or whatever. When having identified this call/routine/function causing the hangup, I will soon have the solution together with your guidance.

So I am happy to install and debug whatever you propose to take a closer look into the 40 seconds of loading the SP structure when loading SP from the main page.

Please keep in mind that although I am an “old” IT professional with a lot of experience in software and hardware, I am by no means an expert in modern web programming or web hosting. So whatever you propose must have this in mind.

Thats it. Now I hope, I made finally clear, what this is all about.

I dont expect anything over the weekend from your service. As I said, we all have family and it is not your job, to debug my installation. As long as there is no identified problem of SP, this is all my problem, I am aware of that.

But a professional step by step approach starting next week, to help me debug the situation from a SP viewpoint, is all I am asking for.

Thanks!