[JAPANESE] [NTCIR Home] [NTCIR Data Home]

NTCIR-11 Temporalia (foster research in temporal information access)

The NTCIR-11 Temporal Information Access (Temporalia) Task is to foster research in temporal information access.
Given the fact that time plays a crucial role in estimating information relevance and validity we believe that successful search engines must consider temporal aspects of information in greater detail.
At NTCIR-11, we build test collections for temporal query intent classification (TQIC) and temporal information retrieval (TIR).

• TQIC: Classifying queries into one of the following temporal classes: past, recency, future, atemporal.
• TIR: Ranking search results for queries that contain a strong temporal requirement.

*(A): Document Data is not distributed from NII. Users are required to obtain it by themselves.
- Please see here.

Living Knowledge Corpus

Please read http://ntcirtemporalia.github.io/NTCIR-11/collection.html

TQIC

For each query the following information is available

The "id" refers to a unique query identifier in the collection.
The "query_string" is the query and the "query_issue_time" is the query submitting date.
The "temporal_class" is the answer class for a query.

TIR

For each topic the following

The "id" refers to a unique query identifier in the collection.
The "title" is brief description of search intents.
The "description" is background and motivation of search.
The "query_issue_time" is the date when the search was conducted.
The "subtopic" is specific question to answer by searching.
The attribute of "type" and "id" in "subtopic" tags are the temporal class and identifier in each question.

relevance judgement

For relevance judgement of each document the following

The "r" column is identifier of each subtopic. The last letter represents a temporal class (a=atemporal, f=future, r=recency, p=past)
The "Document ID" column is document identifier in Living Knowledge Corpus.
The "Rel" column is the relevance assessment value for the topic (L0=Not Relevant, L1=Relevant, L2=Highly Relevant)

The following is the procedure to obtain the test collection. The test collection and data are available from NII free of charge.

• NTCIR-11 Temporalia query data, topic data, and relevance judgement are downloadable from IDR/NII at:
  http://www.nii.ac.jp/dsc/idr/en/ntcir/ntcir.html
  
  
• Document Data is not distributed from NII. Users are required to obtain it by themselves.
  - Living Knowledge Corpus: Please read http://ntcirtemporalia.github.io/NTCIR-11/collection.html
  

Reference

• The terms of use [PDF]
• Overview of the NTCIR-11 Temporalia Task
• NTCIR-11 Temporalia Task website
• NTCIR-11 Temporalia Task Evaluation Results
• Tools

Contact us: ntc-secretariat

Notice

The test collection was constructed and used for the NTCIR project. It is usable only for research purposes.
The document collection included in the test collection was made available to NII for use in the NTCIR project free of charge or for a fee. The providers of the document data understand the importance of such test collections in research on information access technologies and have kindly given their permission to use the data for research purposes. Please remember that the document data in the NTCIR test collection is copyrighted and has commercial value as data. To maintain a good relationship with the data producers/provider, we researchers must be reliable partners and use the data only for research purposes under the user agreement, and we must use the data carefully so as not to violate copyright.

• ---

  [JAPANESE] [NTCIR Home] [Top of this page] [NTCIR Data Home]
  Updated on : 2015-12-04
• ntc-admin