 | | Re: Peeron.com crosses 1000 inventories posted!
|
|
(...) Hey, i'm following up myself once again ;-) Just in case someone thinks I'm just out to take advantage of the hard work of Jennifer and Dan, I tip my hat off to them for working up the energy to start the "experimental engine" and continuing (...) (23 years ago, 8-Jan-02, to lugnet.db.inv)
|
| |
| | Re: Peeron.com crosses 1000 inventories posted!
|
|
(...) Dan told me as much in a private mail exchange a few weeks ago. What I'm doing is getting the set list (only the set list, promise; i'm not spidering the whole site ;-) ) every few days through an anonimyzing proxy and run that through my own (...) (23 years ago, 8-Jan-02, to lugnet.db.inv)
|
| |
| | Re: Peeron.com crosses 1000 inventories posted!
|
|
(...) yup, exactly. so that I won't lock out innocent people, and every will be assumed innocent, until there's reason to be wary. Dan (23 years ago, 8-Jan-02, to lugnet.db.inv)
|
| |
| | Re: Peeron.com crosses 1000 inventories posted!
|
|
(...) Cool... will that be for all users across all domains or only for domains you think are the source of bad spiders? (most users would not have to log in but users from spiderrich domains would log in and get access, except for those users that (...) (23 years ago, 8-Jan-02, to lugnet.db.inv)
|
| |
| | Re: Peeron.com crosses 1000 inventories posted!
|
|
(...) Unfortunatly, we had to block access to t-online.de after repeated spiders downloaded the whole site (ignoring robots.txt). We are limited in the bandwidth we can serve out a month, and didn't want to have the site go down to all, just because (...) (23 years ago, 8-Jan-02, to lugnet.db.inv)
|
