To LUGNET HomepageTo LUGNET News HomepageTo LUGNET Guide Homepage
 Help on Searching
 
Post new message to lugnet.admin.generalOpen lugnet.admin.general in your NNTP NewsreaderTo LUGNET News Traffic PageSign In (Members)
 Administrative / General / 8697
  Re: To LUGNET administrators - BRLUG
 
(...) without first obtaining permission from the site's administrator or owner. It can be tempting to resort to such things, but fetching pages rapidly can cause a terrible load on a webserver, depending on what you're fetching. Crawlers or spiders (...) (24 years ago, 18-Jan-01, to lugnet.admin.general)
 
  Re: To LUGNET administrators - BRLUG
 
Todd, (...) I didn't knew the existence of the (URL) so I came up with a VBScript that uses a generic HTML parser that I wrote (for metasearches websites) to extract data from the Sets Guide and put it into an Access database. The result (very poor (...) (24 years ago, 18-Jan-01, to lugnet.admin.general)
 
  Re: To LUGNET administrators - BRLUG
 
Todd, (...) I am really sorry about that. I will *never* do that again without your permission, you have my word on that. About user agent, let me check the documentation. The documentation don't say, but I guess it has "asphttp" on it. I am using (...) (24 years ago, 18-Jan-01, to lugnet.admin.general)

©2005 LUGNET. All rights reserved. - hosted by steinbruch.info GbR