Confusion matrices for judges 1/3. Judge 1 is represented
on the horizontal axis, while Judge 3 is on the vertical.
The axes represent the accent judgement, and the values in
the matrix are the number of file judgements at each
vertex.

 Arabic
 112 utterances
         1       2       3       4
 1       2       3       3
 2       4       8       7
 3       2       20      59
 4                       2

 BPortuguese
 459 utterances
         1       2       3       4
 1       11      21      10
 2       13      31      24
 3       4       131     208     1
 4                       5

 Cantonese
 261 utterances
         1       2       3       4
 1       4       11      3
 2       3       15      8
 3       3       77      125     1
 4                       7

 Czech
 102 utterances
         1       2       3       4
 1       3       6       1
 2       1       5       9
 3       1       24      52
 4

 Farsi
 261 utterances
         1       2       3       4
 1       3       5
 2       1       14      25
 3       2       55      144
 4                       7       1

 French
 284 utterances
         1       2       3       4
 1       10      15      5
 2       5       22      20
 3       3       72      125     1
 4                       4

 German
 326 utterances
         1       2       3       4
 1       18      28      13
 2       5       32      22
 3       2       70      125
 4                       1

 Hindi
 348 utterances
         1       2       3       4
 1       3       3
 2       2       8       14
 3       5       79      226
 4                       3       1

 Hungarian
 277 utterances
         1       2       3       4
 1       11      12      7       1
 2       4       13      11
 3       2       66      141     1
 4                       4       1

 Japanese
 194 utterances
         1       2       3       4
 1       9       7       4
 2       1       15      8
 3       1       39      102
 4                       6

 Korean
 169 utterances
         1       2       3       4
 1       3       6       3
 2       2       5       3
 3       1       43      94
 4                       8       1

 Malay
 56 utterances
         1       2       3       4
 1               1       2
 2       1       1       4
 3               12      32
 4                       2

 Mandarin
 282 utterances
         1       2       3       4
 1       4       12
 2               17      10
 3       1       74      156     1
 4                       5

 Italian
 214 utterances
         1       2       3       4
 1       10      16      10      1
 2       2       12      3
 3       1       39      101     3
 4                       8       1

 Polish
 143 utterances
         1       2       3       4
 1       5       6       2
 2               7       1
 3       2       30      79      1
 4               1       9

 Spanish
 308 utterances
         1       2       3       4
 1       19      39      17
 2       6       19      16
 3       3       54      108
 4                       5

 IPortuguese
 66 utterances
         1       2       3       4
 1       2       5       1
 2       1       2       2
 3       1       17      35
 4

 Russian
 236 utterances
         1       2       3       4
 1       3       7       4
 2               14      9
 3       4       63      123     1
 4                       7

 Swedish
 203 utterances
         1       2       3       4
 1       14      23      13
 2       7       29      19
 3       3       49      45
 4                       1

 Swahili
 71 utterances
         1       2       3       4
 1               1       1
 2               3       3
 3       2       24      36
 4                       1

 Tamil
 326 utterances
         1       2       3       4
 1       1       3       2
 2       3       10      8
 3               59      207     3
 4                       6

 Vietnamese
 134 utterances
         1       2       3       4
 1       2       4       2
 2       1       6       6
 3       1       22      68      1
 4                       7       1

 ALL Languages
 4961 utterances
         1       2       3       4
 1       151     247     108     2
 2       63      293     236
 3       44      1143    2447    14
 4               2       102     6