To LUGNET HomepageTo LUGNET News HomepageTo LUGNET Guide Homepage
 Help on Searching
 
Post new message to lugnet.admin.generalOpen lugnet.admin.general in your NNTP NewsreaderTo LUGNET News Traffic PageSign In (Members)
 Administrative / General / 8607
  News search function reactivated (was: News search function temporarily disabled)
 
The LUGNET News search function is now re-enabled. I completely revamped the index data structures and list-merge algorithm and rewrote the core query engine in C. It's a much more solid implementation. Everyone's patience during the outage is much (...) (24 years ago, 2-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek, lugnet.announce) !! 
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Very good! Although the new search doesn't return most recent articles first like it used to. Is that how it should work? Now I can't see most recent posts that contain the keyword I want to search for, which makes the search pretty much (...) (24 years ago, 2-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Could I suggest some amendments to the "To do someday" list (for an 'advanced search' only)? - Search by author - Search by subject line contents - Search by date range (or open-ended-- i.e. after date X or before date X) - Search for articles (...) (24 years ago, 2-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Could you tell us the URL syntax for those of us willing to modify URLs? (24 years ago, 2-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Not yet, no. See "to-do soon" section in previous post. (...) For now, if you don't mind URL mucking, you can manually append &qs=<number> to the URL and it will use that number (in seconds) as a time delta. For example, to limit posts to the (...) (24 years ago, 2-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) <snip> (...) I would have to concur. (...) < goes away and tries it... > Umm - Would it not make sense to simply include the appropriate qualifier on the system side? (I tried it and got two year old results for "qs", but I'm probably doing (...) (24 years ago, 2-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Sure! (...) These are mostly covered already due to the way the indexing works -- words closer to the beginning of a document are given higher weights than words occurring later in a document. When the indexer chews on a news article, it first (...) (24 years ago, 2-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Pretty much... actually, I was thinking more along the lines of an advanced search form though: Search for: ___...___ (uses +'s and -'s as is) Search for text in subject line [] (checkbox) Posted by: ___...___ (uses +'s and -'s... or no (...) (24 years ago, 2-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) One thing which would generally make it pretty easy to find URLs is to index "http". When dealing with special characters, definitely treat "/" and "\" as word separators. Probably ":" also. (24 years ago, 2-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Do you index the name in "X-real-life-name"? One thought, index the special strings "from:" and "subject:". The the search: from: ffilz Should rank my posts highly due to proximity. Of course it would be better to index the real life name as (...) (24 years ago, 2-Jan-01, to lugnet.admin.general)
 
  RE: News search function reactivated (was: News search function temporarily disabled)
 
(...) I think a multi-field advanced search is the way to go...much easier to use, IMO--something like the DejaNews power search: (URL) actual search keywords are in one field, and then there are numerouse ways to limit the search. --Bram Bram (...) (24 years ago, 2-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Ya, let's see...as it assembles the text to index, first it grabs X-Real-Life-Name:, then it grabs either Original-From: or From:, then Subject:, then Keywords:, then Summary:, and then finally the non-quoted and non-sig parts of the body. So, (...) (24 years ago, 3-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Ya, something like that'd be good to slap on top after the base functionality. :-) Nobody wants to *have* to remember how all the squiggly and square brace thingums in a search box work. :-) (...) Ya, precisely. It was originally (summer of (...) (24 years ago, 3-Jan-01, to lugnet.admin.general)
 
  Article bit-flags (was: Re: News search function reactivated)
 
(...) Oh, one other thing...planning ahead: Another potential application of article bit-flags is read/unread lists on a person-by-person basis via the web interface. I know this is something that people have been asking for for a long time. When (...) (24 years ago, 3-Jan-01, to lugnet.admin.general)
 
  Re: Article bit-flags (was: Re: News search function reactivated)
 
(...) Ooh ooh ooh... One thing I really really want is to be able to put messages into folders (if anyone knows of a decent newsreader which allows such - please let me know - it would be preferable that it do so without requiring me to store the (...) (24 years ago, 3-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) It works great! ... but the &qs doesn't carry over to the next page of results. So if I want to see more pages, I have to edit the querystring on each page. Since you already have the inner workings of this in place, it would be really easy to (...) (24 years ago, 3-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) oops, doy! I didn't put in the propagation of that URL term. I don't consider it 100% "documented" yet (it's still subject to change without notice), but I still shouldn't have missed that. Thanks. I'll fix that. The reason it's subject to (...) (24 years ago, 3-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Wow! So you have terms for the ampersand options in a URL? My standpoint on this would be to put everything in a form and kill 2 birds with 1 stone - not having to think of how to name URL terms (unless you enjoy doing that) and having the (...) (24 years ago, 3-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Ya, exactly -- first name the URL components carefully and then put a user- friendly level on top of it. Best of both worlds. (...) Ah, I see. Yeah, that could be helpful in certain cases, if you're scouring tons of results! I've needed to (...) (24 years ago, 3-Jan-01, to lugnet.admin.general, lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) As an algorithmical guess, I think I'd probably attempt something a bit different... If someone enters: the I'd probably want to ignore it. But if they entered: the best design I might want to consider the 'the'. Dunno. I'd probably test an (...) (24 years ago, 3-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) All geeks capitulate sooner or later on perl vs C. Of course Larry (and many others I work with) would tell you to write that stuff in Java but that would be a step backwards. Congratulations! Of course it's stability depends greatly on your (...) (24 years ago, 3-Jan-01, to lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) I like Java. But this really needed to be close to the metal and generate code that would fit in the L1 cache for the non-memory-bus-bound portions of the loops. The GNU C compiler is incredible. (...) It's the best C code I've written in 12 (...) (24 years ago, 3-Jan-01, to lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Aah, you definately couldn't have done that in Java. Of course the ability to declare a couple register variables helps too. KL (24 years ago, 3-Jan-01, to lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Of course I've heard of situations where an interpreter outdid hand crafted assembler. This can occur if the portion of the interpreter necessary to run your code fits in the code cache and the byte codes fit in the data cache when the hand (...) (24 years ago, 3-Jan-01, to lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) I probably couldn't, no, but a very experienced Java programmer and a good JVM machine could conceivably do better than C. (It's not unheard of for Java to be faster than C for certain types of things.) The big hits would probably be the JVM (...) (24 years ago, 3-Jan-01, to lugnet.off-topic.geek)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Oh -- actually, what search engines typically do on queries (and I just finally added this last week) is downvalue relatively common words and upvalue relatively uncommon words -- what's called "term ranking" or "term weighting." For example, (...) (24 years ago, 4-Jan-01, to lugnet.admin.general)
 
  Re: News search function reactivated (was: News search function temporarily disabled)
 
(...) Todd, this would be really useful. I'll often search for a recent post, only remembering the poster's name and maybe one or two key-words, and that the post was in the past few days. I don't need two year old messages nearly as frequently. (...) (23 years ago, 5-Feb-01, to lugnet.admin.general)

©2005 LUGNET. All rights reserved. - hosted by steinbruch.info GbR