Welcome, Guest
Username: Password: Remember me
  • Page:
  • 1
  • 2

TOPIC: Help! CPU usage massive on this site

Re: Help! CPU usage massive on this site 2 years 5 months ago #6435

  • sozzled
  • sozzled's Avatar
  • OFFLINE
  • Senior Boarder
  • I'm just a user, mate!
  • Posts: 43
  • Thank you received: 7
  • Karma: 4
dex wrote:
Sorry I didnt mean you. I guess I thought there'd be a common reason. Several kind and helpful people on Kunena, including you, but nothing that resolves the issue so far.

Just doing some more work now - could chat later?
Please use the PM feature at K.org. Let me know how I can contact you (Skype is preferable but telephone is OK, too) by sending me your contact details there.
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 5 months ago #6455

  • dex
  • dex's Avatar
  • OFFLINE
  • Administrator
  • Posts: 41
  • Thank you received: 7
  • Karma: 12
OK i've been chipping silently away at this. I thought we'd have to upgrade our hosting but the hosting company has suggested (bless 'em) that this is un-necessary.

So the search continues. If anyone actually HAS a needle or can move haystacks, step forward.

Today I have
(a) truncated the forum to only 2012 entries, in case it was all too much to bear
(b) truncated redirects, all 10,239 of them, in case URLS were a burden
(c) turned on a few essentials like firewall, JCE, site map
(d) optimised the DB again
(e) frowned a lot at the big numbers
(f) wondered why despite a recount, the Kunena stats are still the same as before the scythe hit

I will wait 24h for another CPU reading, but BEFORE I did the above, we had numbers like this:

Jun 19 2012:
joomla.org.au 2.35 1.16 0.1
Top Process %CPU 136 [php]
Top Process %CPU 101 /index.php
Top Process %CPU 82.0 /index.php

"D- Could do better"

So time to confer again. Perhaps I should upgrade Kunena to 2? What say you Sozzled? I am getting page loads of .97 tonight
Dex Randall
Joomla! web design and production
Sydney Joomla Conference organiser + joomla.org.au site admin
www.spikesystems.com.au
www.twitter.com/dexx
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 5 months ago #6456

  • sozzled
  • sozzled's Avatar
  • OFFLINE
  • Senior Boarder
  • I'm just a user, mate!
  • Posts: 43
  • Thank you received: 7
  • Karma: 4
I say we should talk about it. Please give me a means of contact - as I have suggested on several occasions - and I will talk with you. :)
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 5 months ago #6457

  • MaxTech
  • MaxTech's Avatar
  • OFFLINE
  • Gold Boarder
  • Posts: 220
  • Thank you received: 24
  • Karma: 8
Why 10k+ redirects???? and how would that occur? Try removing all the redirects and see the load time difference (after clearing all cache and history). May make a difference, as to me that many redirects seems insane - if makes little/no difference then it's not the "main" problem.

Surely most of these could be replaced by a couple of "directory" or "Match" redirects?
At some point in time old links need to be let go - goggle just likes to be informed of it sometimes, if it isn't specified in a 301 redirect.

Max
Founder & CEO @ molehill.com.au & successengine.com.au
Partner @ joostrap.com - Joomla! Website Templates & Responsive Web Design
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 5 months ago #6458

  • MaxTech
  • MaxTech's Avatar
  • OFFLINE
  • Gold Boarder
  • Posts: 220
  • Thank you received: 24
  • Karma: 8
and can activate the cache across all of joomla, then disable with:
[url=http://]http://extensions.joomla.org/extensions/core-enhancements/performance/cache/17783[/url]
on just the pages not requiring cache (such as the forum).
Instructions sya:
CacheControl is an easy to use plugin where you can define on what pages caching should be turned off. This can help if you are using extensions that have trouble with caching.
The definitions are straight forward and simple. You just setup the url parameters for each rule and if they match, caching will be turned off for any page that is called with these parameters.
Looks like it may help for issues here?? Max
Founder & CEO @ molehill.com.au & successengine.com.au
Partner @ joostrap.com - Joomla! Website Templates & Responsive Web Design
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 5 months ago #6462

  • dex
  • dex's Avatar
  • OFFLINE
  • Administrator
  • Posts: 41
  • Thank you received: 7
  • Karma: 12
Thanks Max
I turned on as much caching as I could and expires-headers. So perhaps fine-tuning is the way to go.
Am also investigating whether we have enough RAM, as its set to 128Mb - less than recommended.
Dex Randall
Joomla! web design and production
Sydney Joomla Conference organiser + joomla.org.au site admin
www.spikesystems.com.au
www.twitter.com/dexx
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 5 months ago #6463

  • dex
  • dex's Avatar
  • OFFLINE
  • Administrator
  • Posts: 41
  • Thank you received: 7
  • Karma: 12
Ok it wasnt the RAM

Latest ideas:

1. Tune up the DB using ./tuning-primer.sh. Apparently can save 50-70%. Would make sense then that Kunena page load is still slow despite culling. Also if you turn off the 'Thanks' button you can save 2 MySQL queries per thread reply. So in the case of this thread, that's 52 queries.

2. Get Google bot to visit less often (is it set to the standard 0.2 requests per second and 5 seconds between requests in Webmaster tools?)

3. Check out spammers and hackers. Block problem countries. We certainly are getting a lot of hack attempts and there is the reply-to spoof email problem.
Dex Randall
Joomla! web design and production
Sydney Joomla Conference organiser + joomla.org.au site admin
www.spikesystems.com.au
www.twitter.com/dexx
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 4 months ago #6473

  • manuman
  • manuman's Avatar
  • OFFLINE
  • Administrator
  • Posts: 2
  • Karma: 0
Hey Dex,

I'm happy put it on a Nginx. PHP5-FPM, Percona stack and tune it up for you. Would install and use New Relic to identify the source of any inherent issues. Also happy to provide the server (Rackspace Cloud Server) on an ongoing basis as sponsorship in kind if that is of interest.

Cheers
Shayne
Co-Founder of Joomla!
CEO Cloudum Pty. Ltd.
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 4 months ago #6480

  • buipy001
  • buipy001's Avatar
  • OFFLINE
  • Administrator
  • Posts: 47
  • Thank you received: 12
  • Karma: 12
Thanks for your work on it Dex.

Did you manage to pinpoint the main culprit?
The only limitation is your imagination
pbwebdev.com

Twitter: twitter.com/astroboysoup
Facebook: facebook.com/pbwebdev
The administrator has disabled public write access.

Re: Help! CPU usage massive on this site 2 years 4 months ago #6481

  • sozzled
  • sozzled's Avatar
  • OFFLINE
  • Senior Boarder
  • I'm just a user, mate!
  • Posts: 43
  • Thank you received: 7
  • Karma: 4
The administrator has disabled public write access.

Re: CPU usage now small on this site 2 years 4 months ago #6483

  • dex
  • dex's Avatar
  • OFFLINE
  • Administrator
  • Posts: 41
  • Thank you received: 7
  • Karma: 12
Upgraded Kunena to new 2.0 stable release. Page load times are down significantly -yay! (.18-.5 seconds, instead of .8 to 1.0) On ya, Kunena team. Going to bring back pre-2012 posts shortly.

Sozzled, i resent you my contact details earlier as requested, thanks. However upgrading seems to have fixed the problem :)
Dex Randall
Joomla! web design and production
Sydney Joomla Conference organiser + joomla.org.au site admin
www.spikesystems.com.au
www.twitter.com/dexx
Last Edit: 2 years 4 months ago by dex.
The administrator has disabled public write access.

Re: CPU usage now small on this site 2 years 4 months ago #6484

  • dex
  • dex's Avatar
  • OFFLINE
  • Administrator
  • Posts: 41
  • Thank you received: 7
  • Karma: 12
BTW I reloaded all your avatars, but somehow it doesnt know they are there. Not had time to see why yet. I've now enabled Gravatars!
Dex Randall
Joomla! web design and production
Sydney Joomla Conference organiser + joomla.org.au site admin
www.spikesystems.com.au
www.twitter.com/dexx
The administrator has disabled public write access.

Help! CPU usage massive on this site 2 years 4 months ago #6485

  • sozzled
  • sozzled's Avatar
  • OFFLINE
  • Senior Boarder
  • I'm just a user, mate!
  • Posts: 43
  • Thank you received: 7
  • Karma: 4
There is a very important patch needed in K 2.0.0 (see details in www.kunena.org/forum/K-2-0-Support/12348...hp-on-line-60#126869) that must be applied to all J! 2.5.x sites that use K 2.0.0.

A proper fix for this problem will be released at K 2.0.1 in a couple of days' time. In the meantime, make the change recommended in the link I have posted here.

Failure to make this change can result in sites using K 2.0.0. on J! 2.5.x going down with HTTP 500 Internal Server Errors (frontend and backend). J! 1.5.x sites are unaffected.

Big improvement in page load times. K 2.0 uses caching and that's probably why K 1.7.2 (plus caching) caused problems in the past.

:woohoo:
The administrator has disabled public write access.

Re: CPU usage now small on this site 2 years 4 months ago #6486

  • sozzled
  • sozzled's Avatar
  • OFFLINE
  • Senior Boarder
  • I'm just a user, mate!
  • Posts: 43
  • Thank you received: 7
  • Karma: 4
dex wrote:
BTW I reloaded all your avatars, but somehow it doesnt know they are there. Not had time to see why yet. I've now enabled Gravatars!
Although not specifically related to the high CPU usage question, FYI we cannot edit our user profiles because there is a Javascript library conflict here that means the "tabbed" areas on the profiles do not show. At least, I am 99% sure that it's a Javascript library conflict. See msg #1 in www.kunena.org/forum/K-2-0-General-Quest...tion-read-this-first for further information.

Again, if you want, I would be happy to talk this through with you by telephone or Skype if you have the time and if you want to do this. :)
Last Edit: 2 years 4 months ago by sozzled.
The administrator has disabled public write access.

Re: CPU usage now small on this site 2 years 4 months ago #6487

  • dex
  • dex's Avatar
  • OFFLINE
  • Administrator
  • Posts: 41
  • Thank you received: 7
  • Karma: 12
Thanks Sozzled I've applied the patch, but i'm sick with the flu, going back to bed, the avatars I will sort out later.
cheers
Dex
Dex Randall
Joomla! web design and production
Sydney Joomla Conference organiser + joomla.org.au site admin
www.spikesystems.com.au
www.twitter.com/dexx
The administrator has disabled public write access.

Help! CPU usage massive on this site 2 years 4 months ago #6504

  • sozzled
  • sozzled's Avatar
  • OFFLINE
  • Senior Boarder
  • I'm just a user, mate!
  • Posts: 43
  • Thank you received: 7
  • Karma: 4
Hope you are feeling better soon, Dex, and you and I will have that long-overdue (by many months) discussion on Skype, soon.
The administrator has disabled public write access.
  • Page:
  • 1
  • 2
Time to create page: 0.173 seconds
Powered by Kunena Forum