Subject:
|
Re: Address munge and Google...
|
Newsgroups:
|
lugnet.admin.nntp
|
Date:
|
Mon, 27 Nov 2006 12:57:29 GMT
|
Viewed:
|
3517 times
|
| |
|
|
Sorry I didn't notice this sooner:
In lugnet.admin.nntp, Alexander Farlie wrote:
> Hi.
>
> 2 Issues...
>
> 1) E-Mail Addresses in formal headers get munged but not those in the body of
> a message. Is there an easy soloution to this?
No. The e-mail addresses that get "spam-me-notted" (should consider trademarking
this ;-) ) are those that come from the news headers. You can't reliably
identify e-mail addresses in the body of messages, so if you want to try
avoiding those address collectors out there, just do not use plain e-mail
addresses in message bodies. (Asking everyone to comply to a safe rule for
formatting e-mail addresses in messages would probably have the same effect - I
think you get why this is not exactly reasonable)
> 2) Google seems to deep crawl the Lugnet site, is there a way of controlling
> this?
I may have missed something, but why would we want to avoid deep crawling of a
public web site? Yes, there are ways of controlling crawler behavior, however
the side effect would be large portions of LUGNET do not get indexed anymore.
Search hits would go down and so would ultimately the popularity of LUGNET.
There would have been times where network traffic and server performance posed a
limit to deep crawling, but none of these are issues today.
Jerry
|
|
Message is in Reply To:
 | | Address munge and Google...
|
| Hi. 2 Issues... 1) E-Mail Addresses in formal headers get munged but not those in the body of a message. Is there an easy soloution to this? 2) Google seems to deep crawl the Lugnet site, is there a way of controlling this? (18 years ago, 2-Sep-06, to lugnet.admin.nntp)
|
2 Messages in This Thread:
 
- Entire Thread on One Page:
- Nested:
All | Brief | Compact | Dots
Linear:
All | Brief | Compact
|
|
|
|
