Another suggestion would be to turn on whatever debugging features vBulletin includes. I know you can set the *NIX Server Load Limit to, say, 5.00, but that will turn away users if the load limit is reached, which isn't what you want: you want to see the load, not blow up the site when it passes some limit.

What you really want is to install a debug mod - Surviver's is okay - so page load time, number of queries, and server load are displayed. It's tempting to make such information only visible to admins, but in this way, your userbase can be your greatest asset: they can be here at times you're not, and they're typically no-life losers who'll be here for hours at a time. Leverage them to save yourself time; they won't resent it, because ultimately it's helping them, and the more they invest in the board, the more they feel connected and loyal to it.

Not that it's a surprise, I'm sure...but I just experienced quit the lengthy disappearance due to these errors. This time it even had a pretty front end!

Just thought I'd let you know...

Yeah, the site's been out for me for nearly a day.

About the crawlers--since theRPGsite (unlike rpg.net) has a very effective search function in the forums, I could certainly see blocking them. However, I'd note that Google has over the last few months incorporated an improved forum search and sort-of rolled into their google groups search. It may not reduce impact on forums but it's a useful enough feature that (a) it might be worth allowing, and (b) visibility on web searches is a good way to get people interested in the forum. I realize Engine seems to think otherwise but I know I've come across various fora I didn't know about when I've been searching for information.

Quote from: Elliot Wilen;281017I realize Engine seems to think otherwise but I know I've come across various fora I didn't know about when I've been searching for information.

And I've spent the last couple of days - before the crash - seeing if bot crawlage corresponded in any way to the frequency of errors or slowness of pageloads, and while I can't say for certain without being in the admin chair, my observations lead me to believe the crawlers aren't doing heavy harm to the site, and that the problems lie elsewhere. As such, I wouldn't consider blocking the crawlers a priority or even particularly necessary or desirable.

The problem lies with the hosting provider. We will be moving the site to a new service provider in the near-future.

The site utilizes a script to block most crawling bots that don't play nice, so these are not likely the cause of any issues (although it is still possible). Additionally, only registered users can use the search function.

Yes, I've had it with dreamhost. We'll be moving very shortly, which unfortunately means a funding drive earlier in the year; we'll start as soon as Brett has decided what host he thinks would be best for us, and lets me know what we'd need to raise.

RPGPundit

I have been poking around for my own purposes, and these guys seem pretty reasonable:

Web Hosting Buzz

Quote from: RPGPundit;281024Yes, I've had it with dreamhost. We'll be moving very shortly, which unfortunately means a funding drive earlier in the year; we'll start as soon as Brett has decided what host he thinks would be best for us, and lets me know what we'd need to raise.

I just PMed Brett with my suggestion. We recently moved a similar trafficked (SMF) message board to a Linode VPS and ALL the board's  problems went away. As we also moved a bunch of other web sites, we got one of their larger servers (Linode1080, $59.95/month), but a Linode360 ($19.95/month) might handle just this site/board if properly tweaked out. If it doesn't a Linode540 ($29.95/month) should have room to spare.  You can start with the smallest and move to a larger server in 10-20 minutes if you need to.

Quote from: StormBringer;281081I have been poking around for my own purposes, and these guys seem pretty reasonable:

Web Hosting Buzz

Enquiring minds want to know - what purpose hath you, Bringer of Storm?

Quote from: James J Skach;281318Enquiring minds want to know - what purpose hath you, Bringer of Storm?

Wouldn't you like to know?  Are you some kind of spy??

Actually, I want to move the Citadel to a real host with real software one of these days.

Quote from: StormBringer;281323Wouldn't you like to know?  Are you some kind of spy??

Who me? I don't know what you're talking about. OMG - What's that over there?!?!?!?