32 lines
2.4 KiB
Plaintext
32 lines
2.4 KiB
Plaintext
C2 - six corpora, A' against each detector (total; A' w/t/l, p); violations in ()
|
|
K2L: APS 2235(0) 34/65/55 CHA 1437(0) 27/10/8 NEW 4026(0) 85/87/34 RJL 1495(0) 35/29/14 APP 1490(0) 56/69/7 D 4488(0) 84/121/35 | all 15171 vs A' 13032
|
|
K2P: APS 2682(0) 114/24/16 CHA 2526(0) 33/5/7 NEW 5485(0) 104/74/28 RJL 2117(0) 50/16/12 APP 1622(0) 74/50/8 D 6236(0) 110/96/34 | all 20668 vs A' 13032
|
|
K2F: APS 2693(0) 116/22/16 CHA 2526(0) 34/4/7 NEW 5569(0) 112/65/29 RJL 2126(0) 51/15/12 APP 1670(0) 79/40/13 D 6165(0) 113/87/40 | all 20749 vs A' 13032
|
|
|
|
C1 - corpus 4 (decisive): A' total, control total, A' w/t/l, p -> verdict
|
|
K2L: A' 3656 K2L 4488 84/121/35 p=8.2e-06 -> PASSED
|
|
K2P: A' 3656 K2P 6236 110/96/34 p=1.5e-10 -> PASSED
|
|
K2F: A' 3656 K2F 6165 113/87/40 p=2.9e-09 -> PASSED
|
|
C1 overall: PASSED for every control
|
|
|
|
C4 - violations of the 2x bound, all K2 variants, six corpora: 0
|
|
|
|
C5 - corpus 4 by class, A' against the best control (K2L): totals, w/t/l
|
|
D1: A' 433 K2L 429 7/27/6
|
|
D2: A' 1163 K2L 1739 39/0/1
|
|
D3: A' 924 K2L 1207 28/5/7
|
|
D4: A' 304 K2L 306 2/38/0
|
|
D5: A' 503 K2L 477 5/17/18
|
|
D6: A' 329 K2L 330 3/34/3
|
|
|
|
C3 - K1: transform with the true order (m* >= 2 or m* <= 2/3 = 'multiple/fractional')
|
|
APS rest n=154 A' 2259 Chandrupatla(g) 2640 Brent(g) 2734 Chandrupatla(f) 2595 A' vs Ch(g) 103/20/31 p=3.2e-10
|
|
CHA multiple/fractional n= 20 A' 654 Chandrupatla(g) 96 Brent(g) 66 Chandrupatla(f) 1068 A' vs Ch(g) 0/0/20 p=1.9e-06
|
|
CHA rest n= 25 A' 420 Chandrupatla(g) 437 Brent(g) 572 Chandrupatla(f) 437 A' vs Ch(g) 11/4/10 p=1
|
|
NEW multiple/fractional n= 40 A' 1229 Chandrupatla(g) 358 Brent(g) 337 Chandrupatla(f) 1792 A' vs Ch(g) 0/0/40 p=1.8e-12
|
|
NEW rest n=166 A' 2061 Chandrupatla(g) 1924 Brent(g) 2175 Chandrupatla(f) 1924 A' vs Ch(g) 72/33/61 p=0.39
|
|
D multiple/fractional n= 88 A' 2159 Chandrupatla(g) 901 Brent(g) 844 Chandrupatla(f) 4151 A' vs Ch(g) 0/0/88 p=6.5e-27
|
|
D rest n=152 A' 1497 Chandrupatla(g) 1427 Brent(g) 1436 Chandrupatla(f) 1566 A' vs Ch(g) 86/33/33 p=1.3e-06
|
|
m* on the multiple/fractional problems (first 8 per corpus): {'CHA': [3.0, 3.0, 3.0, 3.0, 3.0, 5.0, 5.0, 5.0], 'NEW': [7.75, 9.58, 7.22, 3.22, 7.9, 3.04, 4.68, 9.36], 'D': [7.0, 7.0, 5.0, 5.0, 5.0, 9.0, 3.0, 5.0]}
|
|
controls done
|