NTCIR Workshop 8 GeoTime Task Formal Run Evaluation Results

[NTCIR Home]

Evaluation Results

• Evaluation results for English document search (from English or Japanese topics, i.e. E=>E, J=>E)
  • Results (average precision (AP), Q-measure, nDCG values) for individual runs [GeoTime.EN+1.avr.xlsx]
  • Evaluation results for individual topics [EN+1.formal.pertopic.AP.csv, EN+1.formal.pertopic.Q.csv, EN+1.formal.pertopic.nDCG.csv]
  • Maximum/Median/Minimum AP performance per topic [EN+1.formal.pertopic.AP-max-median-min.xls]
  • Evaluation results for each participating group [BRKLY.EN.formal.qev.tar.gz, DCU.EN.formal.qev.tar.gz, IIIT-H.formal.qev.gz, INESC.EN.formal.qev.tar.gz, UIOWA.EN.formal.qev.tar.gz, XLDB.EN.formal.qev.tar.gz]
• Evaluation results for Japanese document search (from Japanese or English topics, i.e. J=>J, E=>J
  • Results (average precision, Q-measure, nDCG values)for individual runs [GeoTime-JAdedup.avr.xlsx]
  • Evaluation results for individual topics [JA.deduped.pertopic.AP.csv, JA.deduped.pertopic.Q.csv, JA.deduped.pertopic.nDCG.csv]
  • Maximum/Median/Minimum performance per topic [JA.deduped.pertopic.AP-max-median-min.xls]
  • Evaluation results for official participating groups [BRKLY.JA.deduped.qev.tar.gz, FORST.JA.deduped.qev.tar.gz, HU.JA.deduped.qev.tar.gz, KOLIS.JA.deduped.qev.tar.gz, OKSAT.JA.deduped.qev.tar.gz]

 

These results were used in the overview paper:

Gey, F., Larson, R., Kando, N., Machado, J., Sakai, T. (2010) NTCIR-GeoTime Overview: Evaluating Geographic and Temporal Search. In Proceedings of the 8^th NTCIR Workshop Meeting on Evaluation of Information Access Technologies, Tokyo, June 16-18, 2010.