To LUGNET HomepageTo LUGNET News HomepageTo LUGNET Guide Homepage
 Help on Searching
 
Post new message to lugnet.admin.generalOpen lugnet.admin.general in your NNTP NewsreaderTo LUGNET News Traffic PageSign In (Members)
 Administrative / General / 5528
5527  |  5529
Subject: 
Re: errr... 403 Forbidden?
Newsgroups: 
lugnet.admin.general
Date: 
Sun, 26 Mar 2000 05:29:24 GMT
Viewed: 
845 times
  
Todd Lehman wrote:

In lugnet.admin.general, Dan Boger writes:
Todd?  Is it on purpose that when I try to do
get('http://www.lugnet.com');
I get forbidden?  Am I being blocked? ;)  [...]

Not sure without more details.  Can you run it again and note the exact time,
and I'll have a look in the logs.  Most likely, your browser or script is
identifying itself as one of the user agents that gets blocked (mostly
nefarious crawlers or other user agents that have ignored robots.txt).  Also,
when did you first see this, and are you using a different user agent than
when before you saw it?

ok, just tried again:

hermitage$ wwwget http://www.lugnet.com
403 Forbidden <URL:http://www.lugnet.com>
hermitage$ date
Sun Mar 26 00:25:38 EST 2000
hermitage$

I didn't change anything recently, so I guess it started sometime this
past week - I have been working on something else, so I didn't run it
daily as I should. :P

according to the LWP man page, it identifies itself as
"LPW::Simple/#.##" where ### is the version number of my libwww-perl...

Thanks!

Dan



Message has 1 Reply:
  Re: errr... 403 Forbidden?
 
(...) OK, I see it in the logs... "LWP::Simple/5.44"... I don't get how it could ever have worked before... I did recently (last week) update the UA block regex to account for another evil crawler that was tromping around, but LWP::Simple has been (...) (25 years ago, 26-Mar-00, to lugnet.admin.general)

Message is in Reply To:
  Re: errr... 403 Forbidden?
 
(...) Not sure without more details. Can you run it again and note the exact time, and I'll have a look in the logs. Most likely, your browser or script is identifying itself as one of the user agents that gets blocked (mostly nefarious crawlers or (...) (25 years ago, 26-Mar-00, to lugnet.admin.general)

14 Messages in This Thread:



Entire Thread on One Page:
Nested:  All | Brief | Compact | Dots
Linear:  All | Brief | Compact

This Message and its Replies on One Page:
Nested:  All | Brief | Compact | Dots
Linear:  All | Brief | Compact
    

Custom Search

©2005 LUGNET. All rights reserved. - hosted by steinbruch.info GbR