System Work in progress....

Status
Not open for further replies.

LER

Supporter / Pub Member / Server Weenie
Original poster
Sep 28, 2003
7,061
31
Round Rock, TX US
I'm in the process of rebuilding the kernel and user programs for our FreeBSD system to the latest 6.2-STABLE version from 6.1-STABLE.

There will be some quick downtime when it's finished while I reboot to put it all in effect.

We hope this will help with the performance issue we've been seeing.

LER
 
I have noticed that the site is running slow as if bogged down under load and some of the forum icons are not loading right now.
 
Also not sure if this is related to this or to the email issue but Im not getting the notification pop up about private messages within the last 5 days or so ( since I sent Scott a message about atacks ;) )
 
Not at this time, it was basicly during the early morning hours that I was seeing starting around midnight. Not sure about why Im not getting the pop up, try sending me a private message when you have the time and I will see if its just something localized to messages from Scott.
 
Just FYI, at this moment email is not working on the server. This issue was caused by an automatic update by Cpanel, and they are now working on the server to correct this issue.

Because of this POP and IMAP services on SatelliteGuys are unavailable to those who hold a SatelliteGuys email address.

Again work is being done by Cpanel to correct this issue.
 
Ok here is the scoop...

We have been having an issue on our server, where our server load goes from 0.40 to 25.7 (or higher) when this happens the site is VERY slow in fact its unavailable to many. The only way to get everything online again and back to speed is by restarting service on the server (of course when I do this the users get Database errors while the services are restarting)

This could happen once a day, sometimes it did not happen for days or weeks. The server load spike would come out of no where. Yesterday it happened 12 times.

Last week it happened a lot as well, so we contacted both vBulletin (our forum software) and Cpanel (the folks who write software to tie all the parts of our server together nicely) for help.

The Cpanel folks had us run some tests when this problem was happening, and after running these tests they said its a vBulletin issue, sorry we can't help you.

I contacted vBulletin who told me its a cpanel issue and to contact them. I then sent them my log files which seems to show that its a vbulletin problem, and then their tune changed.

They told me to turn off everything that did not come with vBulletin (stuff like the member map, arcade, spell check, webmail, zoints, the chat room, etc...)

I wrote them back and told them that I could not just shut everything off, so I was told to turn them off one by one and see which one seems to solve the issue. And they looked through the logs and said it appeared to be a program that had some mail call functions that was causing the error.

So earlier in the week I shut off the WebMail interface (I myself was SURE this was it) but the next morning the server load shot up and crashed the site..)

So then LER did some updates to our server last night and loaded up the latest OS kernel with the hopes that would fix the problem.

Nope it happened here today twice. That was not the fix.

So now I am going back to the vBulletin advice and am turning off features one by one.

Today the arcade was turned off.

Since the arcade was turned off we have not had the issue. However with that said not enough time has gone by to determine if it is the arcade causing the issue. It could take a few days to tell that, since this problem did not happen every day.

If the arcade IS the issue, hope is not lost. I would then uninstall it (and all the games) and would then reinstall it (cleanly) this would fix a number of small bugs we have seen in the arcade. This arcade was installed over the top of another arcade software in which it replaced it. So a clean install would do us good. It would take awhile to install all 5000 games again but no biggie.

If its not the arcade then we turn it back on and try another feature and see if that correct the issue...

I do appologize for this, as I take great pride in giving you the best and fastest site possible. Over the past few weeks it has been like a full time just just sitting here watching the server load monitor and restarting services as needed to keep things running smoothly. But its something that we should not have to do.

We will get it fixed and thank you for your patience.
 
"We will get it fixed and thank you for your patience."

Thank you for your time and effort.

I figured that's why the Arcade was turned off today.
 
If its not the arcade then we turn it back on and try another feature and see if that correct the issue...
Don't forget it may not be any ONE thing, but rather a combination of things. Turning things off and then back on before turning the next one on may not determine what is the culprit.
 
Yup thats correct too. :) (God I hope thats not the case)

Since the arcade has been flipped off the server has been running very well, however this problem normally happens between 8:30am and 1pm, so we will see tommorow.

Cross your fingers. :D
 
Been through that myself on my mboard, which also uses vB. Shut down one thing at a time until I found what's causing an issue here or there. Like hunting for a needle in a large pile of car parts.
 
Status
Not open for further replies.
***

Users Who Are Viewing This Thread (Total: 1, Members: 0, Guests: 1)

Who Read This Thread (Total Members: 1)