The complete Tipster Corpus is comprised of a test collection built at NIST for the TIPSTER project and the related TREC project. The test collection consists of three CD-ROMs of SGML encoded documents distributed by LDC plus queries and answers (relevant documents) distributed by NIST.
The documents in the test collection are varied in style, size and subject domain. The format of all the documents is relatively clean and easy to use, with SGML-like tags separating documents and document fields. There is no part-of-speech tagging or breakdown into individual sentences or paragraphs as the purpose of this collection is to test retrieval against real-world data.
Tipster Vol. 1
APincludes copyrighted stories from the AP Newswire (1989)DOEincludes short abstracts from the Department of EnergyDTDcontains the dtd-files for AP, DOE, FR, WSJ, ZIFF -filesFRincludes whole issues of the Federal Register (1989)WSJincludes copyrighted stories from the Wall Street Journal (1987, 1988, 1989)ZIFFincludes information from the Computer Select disks (1989/1990, Ziff-Davis Publishing)
Tipster Vol. 2
APincludes copyrighted stories from the AP Newswire (1988)DTDcontains the dtd-files for AP, FR, WSJ, ZIFF -filesFRincludes more issues of the Federal Register (1989)WSJincludes copyrighted stories from the Wall Street Journal (1990, 1991, 1992)ZIFFincludes more information from the Computer Select disks (1989/1990, Ziff-Davis Publishing)
Tipster Vol. 3
APincludes copyrighted stories from the AP Newswire (1990)DTDcontains the dtd-files for AP, PATENTS, SJM, ZIFF -filesPATENTSincludes U.S. Patent Documents (1983-1991)SJMincludes copyrighted stories from the San Jose Mercury News (1991)ZIFFincludes information from the Computer Select disks (1991/1992, Ziff-Davis Publishing)
These disks represent a revision of the first set of disks. There are several files which detail the changes between the previous set of disks and these disks. They are in the files:
README.docA detailed list of changes that were made to disk1, disk2 and disk3, as well as to the qrels files.README.d1A mapping of old document numbers to new document numbers which were changed in the ziff data on disk one.README.d2A mapping of old document numbers to new document numbers which were changed in the ziff data on disk two.README.tagA mapping of old tag names to new tag names which were changed on all three disks.