To LUGNET HomepageTo LUGNET News HomepageTo LUGNET Guide Homepage
 Help on Searching
 
Post new message to lugnet.admin.generalOpen lugnet.admin.general in your NNTP NewsreaderTo LUGNET News Traffic PageSign In (Members)
 Administrative / General / 11713
11712  |  11714
Subject: 
Re: Apply skip filter settings to searches.
Newsgroups: 
lugnet.admin.general
Date: 
Wed, 7 Jul 2004 21:05:20 GMT
Viewed: 
635 times
  
In lugnet.admin.general, Todd Lehman wrote:
   In lugnet.admin.general, Don Heyse wrote:
   In lugnet.admin.general, Todd Lehman wrote:
   In lugnet.admin.general, Kevin Salm wrote:
   I always thought off-topic groups did not show up in search results?? Is this broken now??

Nothing has changed here, no.

Silly me, I should have checked. Would it be worthwhile to post in admin.suggestions? Apparently this came up 4 years ago and you hinted that it might be an easy fix?

http://news.lugnet.com/off-topic/debate/?n=8187

Well, back with the old, slow search engine, at the time I wrote that, it may’ve been fairly easy. Two weeks after that, however, I wrote a brand new search indexer and results engine which runs on the order of 100 times faster, but which doesn’t make such filtering so easy. The old way, what it did was found all the results first, then filtered out everything that wasn’t in the group you were looking in -- a lot of waste. The new way, in addition to being tight C code, uses a completely different approach for indexing: every group, at every level of the hierarchy, has an index file of all articles within that subtree. This intersection of this list and a given word-hit’s list is computed and returned as search results. For the top-level tree (e.g., the entire site encompassing all newsgroups), the index file is essentially a list of all the articles (minus things like .test, .statistics, etc.), and for any given article, the results engine doesn’t know what group the article is in -- it’s just a very fast set processor.

Sounds like the solution is to remove .debate from the top level index file, but leave it in the off-topic subtree index files. How hard could that be?

Don



Message has 2 Replies:
  Re: Apply skip filter settings to searches.
 
(...) That would be trivial. But not a very good solution. --Todd (20 years ago, 7-Jul-04, to lugnet.admin.general, FTX)
  Re: Apply skip filter settings to searches.
 
(...) I think the issue is that then the only way to search for things in off-topic.debate would be to search there explicitly, and conversely, that no posts to off-topic.debate would *ever* show up in a regular search. So (say) if I were looking (...) (20 years ago, 7-Jul-04, to lugnet.admin.general, FTX)

Message is in Reply To:
  Re: Apply skip filter settings to searches.
 
(...) been fairly easy. Two weeks after that, however, I wrote a brand new search indexer and results engine which runs on the order of 100 times faster, but which doesn't make such filtering so easy. The old way, what it did was found all the (...) (20 years ago, 7-Jul-04, to lugnet.admin.general, FTX)

13 Messages in This Thread:




Entire Thread on One Page:
Nested:  All | Brief | Compact | Dots
Linear:  All | Brief | Compact

This Message and its Replies on One Page:
Nested:  All | Brief | Compact | Dots
Linear:  All | Brief | Compact
    

Custom Search

©2005 LUGNET. All rights reserved. - hosted by steinbruch.info GbR