Evaluation Results of the Formal Run [ntc7patmt-fmlrun-final (.xls)]
Readme [readme (.txt) ]
This file includes detailed information for the formal run evaluation for the Patent Translation Task at NTCIR-7. Although a large number of sheets are included in this XLS file, the following four sheets are the results of the formal run.
the result of the intrinsic evaluation
* extrinsic(system description):
the descriptions of the systems participated in the extrinsic evaluation
* extrinsic(dryrun 100 topics):
the result of the extrinsic evaluation for the dry run 100 topics
* extrinsic(new 124 topics)
the result of the extrinsic evaluation for the formal run 124 topics
The remaining sheets include graphs produced from the above information, most of which are used in the following overview paper.
Atsushi Fujii, Masao Utiyama, Mikio Yamamoto, Takehito Utsuro.
Overview of the Patent Translation Task at the NTCIR-7 Workshop.Proceedings of the 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-lingual Information Access, 2008.