Subject:
|
Re: LUGNET not accessible due to traffic load
|
Newsgroups:
|
lugnet.admin.general
|
Date:
|
Tue, 4 Jan 2005 14:16:15 GMT
|
Viewed:
|
345 times
|
| |
|
|
In lugnet.admin.general, Todd Thuma wrote:
> LUGNET Administrators,
I'm one but this is just me talking, not an official answer. I think the guesses
are good though.
> It seems to me that LUGNET is becoming increasingly not available due to traffic
> load. Is this perception wrong?
I have noticed it too... when Todd does, he looks into it. Lately, it usually
has been spiders (webcrawlers, bots, whatever) hammering the server. Todd
determines where they come from and locks out that IP or at least slows it down
> If there is some truth to my perception, is there action that can be taken to
> reduce the dreaded unavailability of LUGNET due to heavy demand on the server?
Urge crawler writers to put throttles into their spiders?
> Now I am no expert on servers, Internet traffic, and such things, but I do know
> that this might require additional costs to allow more MB of traffic each month.
> Is the next level too costly, or can we have a bake sale to cover the costs.I
> bet some people might be willing to buy a T-Shirt to support the next level of
> traffic transfer.
Hopefully that's not needed. If more bandwidth was available, but nothing was
done to throttle spiders, they would suck up the additional bandwidth too.
What I wonder is, is there a clever way to autodetect and block/throttle spiders
without requiring manual intervention? I have no idea.
|
|
Message has 1 Reply:
 | | Re: LUGNET not accessible due to traffic load
|
| (...) I believe this isn't an issue of bandwidth limits, but of server load. When the server gets too busy, the CPU just doesn't keep up with all the requests, and the load goes up. And once the load hits a magic number (20, I think?) the server (...) (20 years ago, 4-Jan-05, to lugnet.admin.general)
|
Message is in Reply To:
| | LUGNET not accessible due to traffic load
|
| LUGNET Administrators, It seems to me that LUGNET is becoming increasingly not available due to traffic load. Is this perception wrong? If there is some truth to my perception, is there action that can be taken to reduce the dreaded unavailability (...) (20 years ago, 4-Jan-05, to lugnet.admin.general)
|
3 Messages in This Thread:
 
- Entire Thread on One Page:
- Nested:
All | Brief | Compact | Dots
Linear:
All | Brief | Compact
This Message and its Replies on One Page:
- Nested:
All | Brief | Compact | Dots
Linear:
All | Brief | Compact
|
|
|
|
