NTCIR Project
Tools
ir4qa_eval

[JAPANESE] [NTCIR Home] [NTCIR Tools Home]

ir4qa_eval

These information retrieval (IR) evaluation scripts were developed for the NTCIR-7 ACLIA IR4QA subtask.
They can be used for other IR tasks at NTCIR, TREC, etc.
The scripts can compute average precision, Q-measure, nDCG and some other evaluation metrics.
For more details, please read the README file included in the tar file.

For the latest version of the evaluation scripts, please visit 'NTCIREVAL'.

Download

http://research.nii.ac.jp/ntcir/tools/cqa_eval.tar.gz
(A patch for the NTCIR-8 community pilot task. ir4qa_eval2 also needs to be installed)
http://research.nii.ac.jp/ntcir/tools/ir4qa_eval2.tar.gz (latest version)
http://research.nii.ac.jp/ntcir/tools/ir4qa_eval.tar.gz