Subject:
|
Re: To LUGNET administrators - BRLUG
|
Newsgroups:
|
lugnet.admin.general
|
Date:
|
Thu, 18 Jan 2001 20:34:32 GMT
|
Viewed:
|
247 times
|
| |
|
|
In lugnet.admin.general, Felipe Coury writes:
> > What are you parsing?
>
> I didn't knew the existence of the http://www.lugnet.com/pause/lists.html
> website, so I came up with a VBScript that uses a generic HTML parser that I
> wrote (for metasearches websites) to extract data from the Sets Guide and
> put it into an Access database. The result (very poor designed yet) can be
> seen at http://brlug.hopto.org.
Please don't run scripts of any kind that fetch HTML pages automatically
without first obtaining permission from the site's administrator or owner.
It can be tempting to resort to such things, but fetching pages rapidly can
cause a terrible load on a webserver, depending on what you're fetching.
Crawlers or spiders can pose a particular mess.
BTW, what user agent string is your fetcher sending?
--Todd
|
|
Message has 1 Reply:
 | | Re: To LUGNET administrators - BRLUG
|
| Todd, (...) I am really sorry about that. I will *never* do that again without your permission, you have my word on that. About user agent, let me check the documentation. The documentation don't say, but I guess it has "asphttp" on it. I am using (...) (24 years ago, 18-Jan-01, to lugnet.admin.general)
|
Message is in Reply To:
| | Re: To LUGNET administrators - BRLUG
|
| Todd, (...) I didn't knew the existence of the (URL) so I came up with a VBScript that uses a generic HTML parser that I wrote (for metasearches websites) to extract data from the Sets Guide and put it into an Access database. The result (very poor (...) (24 years ago, 18-Jan-01, to lugnet.admin.general)
|
10 Messages in This Thread:
 
 
- Entire Thread on One Page:
- Nested:
All | Brief | Compact | Dots
Linear:
All | Brief | Compact
This Message and its Replies on One Page:
- Nested:
All | Brief | Compact | Dots
Linear:
All | Brief | Compact
|
|
|
|
