[JAPANESE] [NTCIR Home] [NTCIR Data Home]

NTCIR-9 RITE (Recognizing Inference in TExt)

NTCIR-9 RITE test collection can be used for experiments of Recognizing Inference in Text, for Chinese (Simplified (CS), Traditional (CT)), and Japanese (JA).

• BC (Binary Class) subtask: Given a text pair (t1,t2) identify whether t1 entails (infers) a hypothesis t2 or not.
• MC (Multi Class) subtask: 5-way labeling task to detect (Forward / Reverse / Bidirection) entailment or no entailment (Contradiction / Independence) in a text pair.
• EXAM (Entrance Exam) subtask: (Japanese Only) Same as the BC subtask in terms of input and output. All the data is created from actual college-level entrance exams.
• RITE4QA (RITE for Question Answering) subtask: Same as the BC subtask in terms of input and output, but as an embedded answer validation component in Question Answering system. This way, the impact of RITE to an overall end-to-end application can be measured.

J: Japanese, E: English, C: Chinese (Cs: simplified Chinese, Ct:traditional Chinese)

* Entrance Exam data for NTCIR-9 RITE is available for task participants in NTCIR-9 workshop, only.
Permission to use the Data is under negotiation. We will announce when it is available.

README

• description-available-data [PDF]
  

Format

<dataset type="bc">
  <pair id="1">
    <t1>石垣島は、冬でもハイビスカスが咲き乱れる楽園だ。</t1>
    <t2>石垣島の冬の気温は高い。</t2>
  </pair>
  <pair id="2">
  : : : 
</dataset>

<dataset type="bc">
  <pair id="1" label="Y">
    <t1>石垣島は、冬でもハイビスカスが咲き乱れる楽園だ。</t1>
    <t2>石垣島の冬の気温は高い。</t2>
  </pair>
  <pair id="2" label="N">
  : : : 
</dataset>

The following is the procedure to obtain the test collection. The test collection and data are available from NII free of charge.

• The application form of the test collection must be filled out and sent by E-mail to ntc-secretariat.
  

• User Agreement (memorandum on Permission to Use Test Collection) is required.

  The user agreement form must be filled out and sent by postal mail or courier to the address below.
  Please download and make two copies of the form (double-sided).
  Signatures are needed on both agreement forms.
  After being counter-signed by the NII side, one copy of the form will be sent to you and one copy will be kept by NII.

• Documents to submit

• Application Form [txt]
• User agreement form [PDF]

Reference

• The terms of use [PDF]
• Overview of NTCIR-9 RITE: Recognizing Inference in TExt
• NTCIR-9 RITE Task website
• Tools (RITE-SDK)

Address

NTCIR Project (Rm.1309)
National Institute of Informatics
2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo
102-8430, JAPAN
PHONE: +81-3-4212-2750
FAX: +81-3-4212-2751
Email: ntc-secretariat

Notice

The test collection was constructed and used for the NTCIR project. It is usable only for research purposes.
The document collection included in the test collection was made available to NII for use in the NTCIR project free of charge or for a fee. The providers of the document data understand the importance of such test collections in research on information access technologies and have kindly given their permission to use the data for research purposes. Please remember that the document data in the NTCIR test collection is copyrighted and has commercial value as data. To maintain a good relationship with the data producers/provider, we researchers must be reliable partners and use the data only for research purposes under the user agreement, and we must use the data carefully so as not to violate copyright.

ntc-admin