Formal Run Results of Web Retrieval Task at the Third NTCIR Workshop (NTCIR-3)

Executives Committee of the NTCIR-3 Web Retrieval Task
ntcadm-web@nii.ac.jp
Last Modified: Sep 10, 2002


  1. Introduction (PDF format)
  2. Overview of Systems Description (PDF format)
  3. Evaluation Result Sheets (PDF format)
    1. The Large-scale (100 Gigabytes)
    2. The Small-scale (10 Gigabytes)
  4. Summary of Evaluation Results --Graphs-- (PDF format)
    1. The Large-scale (100 Gigabytes)
    2. The Small-scale (10 Gigabytes)
  5. Topics (text format)
  6. Lists of Queries and the Relevance Assessment (text format accordings to 'trec_eval')
    1. The Large-scale (100 Gigabytes)
    2. The Small-scale (10 Gigabytes)

  1. Introduction (PDF format)
  2. Overview of Systems Description (PDF format)
  3. Evaluation Result Sheets (PDF format)
    1. The Large-scale (100 Gigabytes)
    2. The Small-scale (10 Gigabytes)
  4. Summary of Evaluation Results --Graphs-- (PDF format)
    1. The Large-scale (100 Gigabytes)
    2. The Small-scale (10 Gigabytes)
  5. Topics (text format)
    1. The Topics Delivered (EUC coding)
    2. The Topics Delivered (SJIS coding)
    3. The English-translated Topics
  6. Lists of Queries and the Relevance Assessment (text format accordings to 'trec_eval')
    1. The Large-scale (100 Gigabytes)
      1. Without considering links
        1. Relevant Level 0 (H)
        2. Relevant Level 1 (H or A; Rigid)
        3. Relevant Level 2 (H, A or B; Relaxed)
      2. With considering links
        1. Relevant Level 0 (H)
        2. Relevant Level 1 (H or A; Rigid)
        3. Relevant Level 2 (H, A or B; Relaxed)
    2. The Small-scale (10 Gigabytes)
      1. Without considering links
        1. Relevant Level 0 (H)
        2. Relevant Level 1 (H or A; Rigid)
        3. Relevant Level 2 (H, A or B; Relaxed)
      2. With considering links
        1. Relevant Level 0 (H)
        2. Relevant Level 1 (H or A; Rigid)
        3. Relevant Level 2 (H, A or B; Relaxed)