NTCIR-6 Patent Retrieval Task
jp: Japanese Retrieval Subtask
system_description: brief technical descriptions of each system
- comparison: MAP and precision at various recall points for participating systems
- def0: relevance degree used in NTCIR-5
- all.a.csv: All topics with "A" relevant documents
- all.b.csv: All topics with "A" and "B" relevant documents
- ntc4.a.csv: NTCIR-4 topics with "A" relevant documents
- ntc4.b.csv: NTCIR-4 topics with "A" and "B" relevant documents
- ntc5.a.csv: NTCIR-5 topics with "A" relevant documents
- ntc5.b.csv: NTCIR-5 topics with "A" and "B" relevant documents
- ntc6.a.csv: NTCIR-6 topics with "A" relevant documents
- ntc6.b.csv: NTCIR-6 topics with "A" and "B" relevant documents
- sr.a.csv: Search Report topics with "A" relevant documents
- sr.b.csv: Search Report topics with "A" and "B" relevant documents
- def1: relevance degree used in NTCIR-6
- all.h.csv: All topics with "H" relevant documents
- all.a.csv: All topics with "H" and "A" relevant documents
- all.b.csv: All topics with "H", "A", and "B" relevant documents
- ntc4.h.csv: NTCIR-4 topics with "H" relevant documents
- ntc4.a.csv: NTCIR-4 topics with "H" and "A" relevant documents
- ntc4.b.csv: NTCIR-4 topics with "H", "A", and "B" relevant documents
- ntc5.h.csv: NTCIR-5 topics with "H" relevant documents
- ntc5.a.csv: NTCIR-5 topics with "H" and "A" relevant documents
- ntc5.b.csv: NTCIR-5 topics with "H", "A", and "B" relevant documents
- ntc6.h.csv: NTCIR-6 topics with "H" relevant documents
- ntc6.a.csv: NTCIR-6 topics with "H" and "A" relevant documents
- ntc6.b.csv: NTCIR-6 topics with "H", "A", and "B" relevant documents
- sr.h.csv: Search Report topics with "H" relevant documents
- sr.a.csv: Search Report topics with "H" and "A" relevant documents
- sr.b.csv: Search Report topics with "H", "A", and "B" relevant documents
Note(1)
Please see the following paper for details of "def0" and "def1":
Atsushi Fujii, Makoto Iwayama, and Noriko Kando.
Overview of the Patent Retrieval Task at the NTCIR-6 Workshop.
Proceedings of the Sixth NTCIR Workshop Meeting, 2007.
Note(2)
While BETA6-run1 was evaluated with all retrieved documents, BETA6-run1_c was evaluated only with the top documents that were retrieved confidently.
en: English Retrieval Subtask
system_description: brief technical descriptions of each system
- comparison: MAP and precision at various recall points for participating systems
- a.csv: "A" relevant documents
- b.scv: "A" and "B" relevant documents
cl: Classification Subtask
ntc6.formalrun.result.xls: complete evaluation results (precision at various recall points, average precision, f-measure, etc.)