[310] in Information Retrieval
Re: Information Shootout
daemon@ATHENA.MIT.EDU (David R. Karger)
Wed May 15 15:39:36 1996
Date: Wed, 15 May 96 15:37:56 EDT
From: "David R. Karger" <karger@theory.lcs.mit.edu>
To: owens@MIT.EDU
Cc: dlicc@MIT.EDU, elibdev@MIT.EDU
In-Reply-To: <9605151640.AA17521@thin-ice.MIT.EDU> (message from Tom Owens on
Wed, 15 May 1996 12:40:54 EDT)
While the knowledge shootout seems interesting, it seems to be
addressing a lot of statistical information questions rather than the
"find the right documents" type. Library folks might be more
interested in the ongoing annual TIPSTER/TREC evaluation carried out
by the national institute of standards. Each year they release a
CDROM containing gigabytes of text (news articles, government docs,
etc) and a large set of questions. People try to use their software
to identify relevant documents for each question. Results are judged
by a panel of human experts on the topics.
You can find out about them at http://potomac.ncsl.nist.gov/TREC/
-d