Formal Run Results of NTCIR-3 Patent Retrieval Task

1. Results Overview

• Mandatory runs (<ARTICLE>+<SUPPLEMENT>)
  • Relevant = A [gif, html]
  • Relevant = A+B [gif, html]
• Optional runs (others)
  • Relevant = A [gif, html]
  • Relevant = A+B [gif, html]

2. Topic-by-topic Results

• Median of average precisions (all runs) [gif]
• Difference from median average precision for each run
  • Mandatory runs
    • Relevant = A [html(JavaScript), xls]
    • Relevant = A+B [html(JavaScript), xls]
  • All runs
    • Relevant = A [html(JavaScript), xls]
    • Relevant = A+B [html(JavaScript), xls]
• Breakdown of relevance judgments [gif]