| | Re: To LUGNET administrators - BRLUG
|
| (...) without first obtaining permission from the site's administrator or owner. It can be tempting to resort to such things, but fetching pages rapidly can cause a terrible load on a webserver, depending on what you're fetching. Crawlers or spiders (...) (24 years ago, 18-Jan-01, to lugnet.admin.general)
| | | | Re: To LUGNET administrators - BRLUG
|
| Todd, (...) I am really sorry about that. I will *never* do that again without your permission, you have my word on that. About user agent, let me check the documentation. The documentation don't say, but I guess it has "asphttp" on it. I am using (...) (24 years ago, 18-Jan-01, to lugnet.admin.general)
| |