[JAPANESE] [NTCIR Home] [NTCIR Data Home]

NTCIR-9 RITE (Recognizing Inference in TExt)

NTCIR-9 RITE test collection can be used for experiments of Recognizing Inference in Text, for Chinese (Simplified (CS), Traditional (CT)), and Japanese (JA).

• BC (Binary Class) subtask: Given a text pair (t1,t2) identify whether t1 entails (infers) a hypothesis t2 or not.
• MC (Multi Class) subtask: 5-way labeling task to detect (Forward / Reverse / Bidirection) entailment or no entailment (Contradiction / Independence) in a text pair.
• EXAM (Entrance Exam) subtask: (Japanese Only) Same as the BC subtask in terms of input and output. All the data is created from actual college-level entrance exams.
• RITE4QA (RITE for Question Answering) subtask: Same as the BC subtask in terms of input and output, but as an embedded answer validation component in Question Answering system. This way, the impact of RITE to an overall end-to-end application can be measured.

J: Japanese, E: English, C: Chinese (Cs: simplified Chinese, Ct:traditional Chinese)

* Entrance Exam data for NTCIR-9 RITE is available for task participants in NTCIR-9 workshop, only.
Permission to use the Data is under negotiation. We will announce when it is available.

README

• description-available-data [PDF]
  

Format

<dataset type="bc">
  <pair id="1">
    <t1>石垣島は、冬でもハイビスカスが咲き乱れる楽園だ。</t1>
    <t2>石垣島の冬の気温は高い。</t2>
  </pair>
  <pair id="2">
  : : : 
</dataset>

<dataset type="bc">
  <pair id="1" label="Y">
    <t1>石垣島は、冬でもハイビスカスが咲き乱れる楽園だ。</t1>
    <t2>石垣島の冬の気温は高い。</t2>
  </pair>
  <pair id="2" label="N">
  : : : 
</dataset>

How to obtain Document Data;
https://research.nii.ac.jp/ntcir/permission/perm-en-DocumentData.html

• Documents to submit

• Application Form [txt]
• User agreement form (sent by email)

Reference

• The terms of use [PDF]
• Overview of NTCIR-9 RITE: Recognizing Inference in TExt
• NTCIR-9 RITE Task website
• Tools (RITE-SDK)

Notice

The test collection was constructed and used for the NTCIR project. It is usable only for research purposes.
The document collection included in the test collection was made available to NII for use in the NTCIR project free of charge or for a fee. The providers of the document data understand the importance of such test collections in research on information access technologies and have kindly given their permission to use the data for research purposes. Please remember that the document data in the NTCIR test collection is copyrighted and has commercial value as data. To maintain a good relationship with the data producers/provider, we researchers must be reliable partners and use the data only for research purposes under the user agreement, and we must use the data carefully so as not to violate copyright.

ntc-admin