This file contains the summary of evaluation results in 
the CCLQA task (main track and Collaboration track).

Legend: 
 - Pre-Human: F3 score from by the preliminary human evaluation
 - Pre-Auto: F3 score from by the preliminary automatic evaluation
 - Rev-Auto: F3 score from by the revised automatic evaluation

To find more details, see the ACLIA overview paper.

======== CCLQA ========

Run ID           | Pre-Human  Pre-Auto  Rev-Auto
-----------------+--------------------------------
WHUQA-EN-CS-01-T |    0.1841    0.3070    0.2895
                 | 
APQA-CS-CS-01-T  |    0.1388    0.3199    0.3117
APQA-CS-CS-01-D  |    0.1422    0.2825    0.2668
DLUT-CS-CS-01-T  |    0.1954    0.3154    0.3080
KECIR-CS-CS-01-T |    0.3450    0.4719    0.4614
KECIR-CS-CS-02-T |    0.3354    0.4389    0.4502
WHUQA-CS-CS-01-T |    0.2566    0.3671    0.3513
                 | 
NTOUA-EN-CT-01-T |    0.1096    0.1783    0.1813
NTOUA-EN-CT-02-T |    0.1362    0.2088    0.2035
NTOUA-EN-CT-03-T |    0.1159    0.1718    0.1717
                 | 
NTOUA-CT-CT-01-T |    0.1815    0.2909    0.2823
NTOUA-CT-CT-02-T |    0.1988    0.2694    0.2579
NTOUA-CT-CT-03-T |    0.1461    0.1926    0.1885
                 | 
LTI-EN-JA-01-T   |    0.1074    0.2286    0.2107
LTI-EN-JA-02-T   |    0.1130    0.2199    0.2029
LTI-EN-JA-03-T   |    0.1045    0.2184    0.2040
                 | 
LTI-JA-JA-01-T   |    0.1069    0.2290    0.2024
LTI-JA-JA-02-T   |    0.1443    0.2419    0.2259
LTI-JA-JA-03-T   |    0.1438    0.2405    0.2252

======== Collaboration ========

Run ID                 | Rev-Auto
-----------------------+----------
CYUT-LTI-EN-JA-01-T    |  0.3169
CYUT-LTI-EN-JA-02-T    |  0.3252
CYUT-LTI-EN-JA-03-D    |  0.3358
CYUT-LTI-EN-JA-04-DN   |  0.3349
                       |
BRKLY-LTI-JA-JA-01-DN  |  0.2934
BRKLY-LTI-JA-JA-02-T   |  0.2686
BRKLY-LTI-JA-JA-03-DN  |  0.2074
BRKLY-LTI-JA-JA-04-DN  |  0.3000
BRKLY-LTI-JA-JA-05-T   |  0.2746
                       |
CYUT-NTOUA-EN-CT-01-T  |  0.1520
CYUT-NTOUA-EN-CT-02-T  |  0.1679
CYUT-NTOUA-EN-CT-03-T  |  0.1608
KDEG-NTOUA-EN-CT-01-T  |  0.1726
KDEG-NTOUA-EN-CT-02-T  |  0.1790
KDEG-NTOUA-EN-CT-03-T  |  0.1654
QUTIS-NTOUA-EN-CT-01-T |  0.1287
QUTIS-NTOUA-EN-CT-02-T |  0.1479
QUTIS-NTOUA-EN-CT-03-T |  0.1466
                       |
KDEG-NTOUA-CT-CT-01-T  |  0.2973
KDEG-NTOUA-CT-CT-02-T  |  0.2797
KDEG-NTOUA-CT-CT-03-T  |  0.2649