 | | Re: LEGO instructions
|
| (...) Well it takes about 7 days to check them all. And it's only grabbing the header unless it's a new file. (...) Yeah, we'll see. ROSCO (20 years ago, 16-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) Ahh. Yeah, I could see that as being potentially red-flagging, if they're getting a million hits in a short period of time. I was definitely thinking smaller scale than that. (...) Heh, the inevitable 1st level of tech support :) It will be (...) (20 years ago, 16-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) Ahh. Yeah, I could see that as being potentially red-flagging, if they're getting a million hits in a short period of time. I was definitely thinking smaller scale than that. (...) Heh, the inevitable 1st level of tech support :) It will be (...) (20 years ago, 16-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) It's more complicated than that, because the PDFs are stored by the 7 digit LEGO number, not the set number. Basically I scan the header of all files in a certain range (about 1 million), and if it is a PDF I check against my database, (...) (20 years ago, 15-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) Hm. given what you're talking about, it doesn't seem terribly likely that they'd shut down your IP based on that alone-- unless your polls are REALLY hitting them hard. But I'm assuming you're doing something like: for each set in the Lugnet (...) (20 years ago, 15-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) To put a number on it, I have received 22329 requests to my page since April. That's total requests, including non-search, and failed search requests. I have no way to tell how many requests that generated for lego.com, and besides, blocking (...) (20 years ago, 15-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) I poll from Australia, roughly once a month. (...) that URL. Which either means they are blocking the same IPs on that server too, or it is a temporary cache and it has been flushed (in which case it is useless for polling). (...) I do not (...) (20 years ago, 15-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) Negligible. I would guess LEGO's own instruction download page probably generates significantly more. ROSCO (20 years ago, 15-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) I just tried it, and it gave me 'Server error' when clicking on the link. Right clicking in the browser (FireFox) and choosing 'Save link as...' worked! Clicking on the link again also seems to work now, so maybe it's just some intermittent (...) (20 years ago, 15-Sep-06, to lugnet.lego.direct)
| | | | | Re: LEGO instructions
|
| (...) So... I don't quite understand-- It says your site is hosted at NorthStar, which is in Chicago, yes? Are you scanning Lego's site from that server, or from a machine in Australia? Other question I guess would be how often do you poll? Of (...) (20 years ago, 15-Sep-06, to lugnet.lego.direct)
|
|
