Evaluation Results

1. E2CJK Tasks
   
• Evaluation Scores with LMAP and P@N metrics:


• E2C Results
F2F evaluation Wikipedia ground-truth: LMAP and R-PREC, P@N
F2F evaluation with manual assessment results: LMAP and R-PREC, P@N
A2F evaluation with manual assessment results: LMAP and R-PREC, P@N



• E2J Results
F2F evaluation Wikipedia ground-truth: LMAP and R-PREC, P@N
F2F evaluation with manual assessment results: LMAP and R-PREC, P@N
A2F evaluation with manual assessment results: LMAP and R-PREC, P@N



• E2K Results
F2F evaluation Wikipedia ground-truth: LMAP and R-PREC, P@N
F2F evaluation with manual assessment results: LMAP and R-PREC, P@N
A2F evaluation with manual assessment results: LMAP and R-PREC, P@N



• Interpolated Precision-Recall Curves:
  • E2C
  P-R curves of runs in F2F evaluation with Wikipedia ground-truth
  
  P-R curves of runs in F2F evaluation with manual assessment results
  
  P-R curves of runs in A2F evaluation with manual assessment results
  
  
  • E2J
  P-R curves of runs in F2F evaluation with Wikipedia ground-truth
  
  P-R curves of runs in F2F evaluation with manual assessment results
  
  P-R curves of runs in A2F evaluation with manual assessment results
  
  
  • E2K
  P-R curves of runs in F2F evaluation with Wikipedia ground-truth
  
  P-R curves of runs in F2F evaluation with manual assessment results
  
  P-R curves of runs in A2F evaluation with manual assessment results
  
  



2. CJK2E Tasks
• Evaluation Scores with LMAP and R-PREC, P@N metrics:


• C2E Results
F2F evaluation Wikipedia ground-truth: LMAP and R-PREC, P@N
F2F evaluation with manual assessment results: LMAP and R-PREC, P@N
A2F evaluation with manual assessment results: LMAP and R-PREC, P@N



• J2E Results
F2F evaluation Wikipedia ground-truth: LMAP and R-PREC, P@N
F2F evaluation with manual assessment results: LMAP and R-PREC, P@N
A2F evaluation with manual assessment results: LMAP and R-PREC, P@N



• K2E Results
F2F evaluation Wikipedia ground-truth: LMAP and R-PREC, P@N
F2F evaluation with manual assessment results: LMAP and R-PREC, P@N
A2F evaluation with manual assessment results: LMAP and R-PREC, P@N



• Interpolated Precision-Recall Curves:
  • C2E
  P-R curves of runs in F2F evaluation with Wikipedia ground-truth
  
  P-R curves of runs in F2F evaluation with manual assessment results
  
  P-R curves of runs in A2F evaluation with manual assessment results
  
  
  • J2E
  P-R curves of runs in F2F evaluation with Wikipedia ground-truth
  
  P-R curves of runs in F2F evaluation with manual assessment results
  
  P-R curves of runs in A2F evaluation with manual assessment results
  
  
  • K2E
  P-R curves of runs in F2F evaluation with Wikipedia ground-truth
  
  P-R curves of runs in F2F evaluation with manual assessment results
  
  P-R curves of runs in A2F evaluation with manual assessment results