NTCIR Math Task aims to explore search methods tailored to mathematical content through the design of suitable search tasks and the construction of evaluation datasets.

• arXiv main task: Given a collection of scientific papers, retrieve relevant documents for a given query.
• arXiv simto task: Given a collection of scientific papers, retrieve relevant documents for a given query with 'similarity' regions to distinguish subexpressions that should be identical to the query from those that are similar to the query in some sense.
• Wikipedia main task: Given a collection of Wikipedia articles, retrieve relevant mathematical formulae or documents for a given query.
• Wikipedia formula task: Given a collection of Wikipedia articles, retrieve relevant mathematical formulae for a given mathematical formula query.

arXiv collection

• For arXiv Document collection, please contact KWARC Project.

Wikipedia collection

• Document data is available at https://www.cs.rit.edu/~rlaz/NTCIR-12_MathIR_Wikipedia_Corpus.zip

Topics:

• Documentation for search topic format
• Topics for arXiv and Wikipedia Tasks (for participants) (files are available from NII/IDR: please see here.)
• Topics for arXiv and Wikipedia Tasks (for judges) (files are available from NII/IDR: please see here.)

Relevance Judgement Results:

• Relevance Judgement files (files are available from NII/IDR: please see here.)

Tools

• Submission Validation Script
• Evaluation Script (files are available from NII/IDR: please see here.)

The test collection and data are available from NII free of charge.

• NTCIR-12 MathIR task files are downloadable from NII/IDR at:
  NII IDR: http://www.nii.ac.jp/dsc/idr/en/ntcir/ntcir.html

Reference

• The terms of use [PDF]
• NTCIR-12 MatHIR Task Overview
• NTCIR-12 MathIR website
  http://ntcir-math.nii.ac.jp/
• NTCIR-12 Conference Proceedings: MathIR
  MathIR
• NTCIR-12 MathIR Evaluation Results
  MathIR
• Tools
  http://research.nii.ac.jp/ntcir/tools/tools-en.html

Contact us: ntc-secretariat