(...) There's a little trick I use a lot to weed out duplicates: If the article being examined is in a group that's not the first one listed in the Newsgroups: header, then ignore that article, because it'll be examined in another directory. I'm (...) (20 years ago, 21-Jan-05, to lugnet.admin.general, FTX)
(...) That's some pretty smart thinking. Of course, now I'm tempted to just throw the data into an SQL db... Hmmm. (20 years ago, 21-Jan-05, to lugnet.admin.general)
