PREREG_modab outcome (server): M1 PASSED - A' ahead of ModAB (authors' package pymodab 1.0.9, same stopping rule, counts equal to the library's own counter). Corpus 4: A' 3656 vs ModAB 5535, per problem 183/23/34 p=7e-26. Paper protocol: APS 2438 vs 2914 (118/11/25), CHA 2005 vs 2436 (32/9/4). Six corpora: 13032 vs 16657, significant on every one. ModAB's own benchmark (Roots.jl f01-f91): all 91 - 1507 vs 1588 (56/13/22 p=1.5e-4); 78 - 1371 vs 1446. ModAB breaks the 2x-bisection bound on 9 problems (1 on corpus 1, 8 on corpus 4), A' on none. ModAB wired outside the published grid (EXTRA_BASELINES), which stays at 264.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
vvs
2026-09-21 21:35:36 +01:00
co-authored by Claude Opus 5
parent bfa23b223d
commit 37c81b027a
5 changed files with 191 additions and 2 deletions
+25
View File
@@ -0,0 +1,25 @@
PAPER PROTOCOL (published roots)
APS: A' 2438 ModAB 2914 (solved 153, over 0) Chandrupatla 2787 A' vs ModAB 118/11/25 p=1.2e-15
CHA: A' 2005 ModAB 2436 (solved 40, over 0) Chandrupatla 2441 A' vs ModAB 32/9/4 p=1.9e-06
SIX CORPORA (uniform criterion): A' / ModAB / Chandrupatla totals; ModAB violations; A' vs ModAB
APS 2259 / 2726 / 2595 viol 0 118/10/26 p=3.4e-15
CHA 1074 / 1681 / 1505 viol 0 34/4/7 p=2.5e-05
NEW 3290 / 3809 / 3716 viol 1 125/26/55 p=1.9e-07
RJL 1371 / 1446 / 1566 viol 0 47/11/20 p=0.0013
APP 1382 / 1460 / 1382 viol 0 76/35/21 p=1.7e-08
D 3656 / 5535 / 5717 viol 8 183/23/34 p=7.1e-26
all 13032 / 16657
M1 (corpus 4): PASSED - A' 3656 vs ModAB 5535, 183/23/34 p=7.1e-26
D1: A' 433 ModAB 446 24/5/11
D2: A' 1163 ModAB 1689 39/0/1
D3: A' 924 ModAB 1267 34/0/6
D4: A' 304 ModAB 362 36/3/1
D5: A' 503 ModAB 1425 26/7/7
D6: A' 329 ModAB 346 24/8/8
MODAB'S OWN BENCHMARK (Roots.jl f01-f91)
all 91: Aprime 1507 modab 1588 chandrupatla 1701 A' vs ModAB 56/13/22 p=0.00015 ModAB viol 0
78 out of the development sets: Aprime 1371 modab 1446 chandrupatla 1566 A' vs ModAB 47/11/20 p=0.0013 ModAB viol 0
modab done