Files
sim-numerics/results_table_wins_losses.txt
T
vvsandClaude Opus 5 baa93963cf PREREG_flat_exp_limit outcome: ACCEPTED (server numbers equal to the smoke in every projection cell; 0 violations in the guaranteed family).
Translation limit of the analogy (f shrank, x-scale did not -> m = inf):
  defect + remembered + point + exp        APS 2531  CHA 1972  both 4503
  G2 + defect + remembered + point + exp   APS 2588  CHA 1997  both 4585
  G2 + contra + remembered + point + exp   APS 2773  CHA 2073  both 4846
  Chandrupatla                             APS 2787  CHA 2441  both 5228
Per problem against Chandrupatla now SIGNIFICANT ON BOTH SETS: G2+contra+rem+pt+exp APS 98/18/37 p=1.5e-7, CHA 28/3/9 p=0.0026; defect+rem+pt+exp APS 86/20/47 p=9e-4, CHA 27/3/10 p=0.0076.
NOT where predicted: fun9 only -1..-3; the gain is on the flat families (x^9 177 -> 161, x^19 339 -> 167).
Server regression x2: 1179 passed, 1 failed = the paper-number check.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-21 18:44:23 +01:00

54 lines
4.6 KiB
Plaintext

TOTALS (evaluations of f, failures charged 200)
method APS CHA both
proposed rule 2806 3220 6026
+ G2 (step pattern) 2782 3169 5951
+ G2 + analogy entry 2780 2625 5405
+ contra + remembered analogy 2792 2537 5329
+ defect + remembered analogy 2530 2561 5091
+ G2 + analogy + ORDER POINT 2780 2221 5001
+ G2 + contra + rem. + ORDER PT 2775 2119 4894
+ defect + rem. + ORDER POINT 2532 2164 4696
+ G2 + contra + rem. + pt + EXP 2773 2073 4846
+ defect + rem. + pt + EXP 2531 1972 4503
Chandrupatla 2787 2441 5228
Brent 2889 4115 7004
TOMS748 2820 4000 6820
PER PROBLEM, ours against each rival: wins/ties/losses (sign-test p)
APS
proposed rule Chandrupatla 87/24/42 p=9.2e-05 Brent 102/11/40 p=2e-07 TOMS748 86/16/51 p=0.0035
+ G2 (step pattern) Chandrupatla 95/20/38 p=8.2e-07 Brent 110/9/34 p=1.5e-10 TOMS748 97/15/41 p=2.1e-06
+ G2 + analogy entry Chandrupatla 95/20/38 p=8.2e-07 Brent 110/9/34 p=1.5e-10 TOMS748 97/15/41 p=2.1e-06
+ contra + remembered analogy Chandrupatla 90/23/40 p=1.4e-05 Brent 105/11/37 p=9.9e-09 TOMS748 87/16/50 p=0.002
+ defect + remembered analogy Chandrupatla 86/20/47 p=0.00091 Brent 101/13/39 p=1.6e-07 TOMS748 107/11/35 p=1.1e-09
+ G2 + analogy + ORDER POINT Chandrupatla 95/20/38 p=8.2e-07 Brent 110/9/34 p=1.5e-10 TOMS748 97/15/41 p=2.1e-06
+ G2 + contra + rem. + ORDER PT Chandrupatla 98/18/37 p=1.5e-07 Brent 112/8/33 p=3e-11 TOMS748 98/15/40 p=8.5e-07
+ defect + rem. + ORDER POINT Chandrupatla 86/20/47 p=0.00091 Brent 101/12/40 p=2.9e-07 TOMS748 107/11/35 p=1.1e-09
+ G2 + contra + rem. + pt + EXP Chandrupatla 98/18/37 p=1.5e-07 Brent 112/8/33 p=3e-11 TOMS748 98/15/40 p=8.5e-07
+ defect + rem. + pt + EXP Chandrupatla 86/20/47 p=0.00091 Brent 101/12/40 p=2.9e-07 TOMS748 107/11/35 p=1.1e-09
CHA
proposed rule Chandrupatla 9/5/26 p=0.006 Brent 30/4/4 p=6.2e-06 TOMS748 31/1/8 p=0.00029
+ G2 (step pattern) Chandrupatla 10/3/27 p=0.0076 Brent 30/2/6 p=7e-05 TOMS748 31/1/8 p=0.00029
+ G2 + analogy entry Chandrupatla 9/6/25 p=0.009 Brent 30/2/6 p=7e-05 TOMS748 36/1/3 p=3.6e-08
+ contra + remembered analogy Chandrupatla 8/7/25 p=0.0046 Brent 31/4/3 p=7.7e-07 TOMS748 37/1/2 p=2.8e-09
+ defect + remembered analogy Chandrupatla 8/5/27 p=0.0019 Brent 30/2/6 p=7e-05 TOMS748 35/1/4 p=3.4e-07
+ G2 + analogy + ORDER POINT Chandrupatla 24/3/13 p=0.099 Brent 30/2/6 p=7e-05 TOMS748 35/1/4 p=3.4e-07
+ G2 + contra + rem. + ORDER PT Chandrupatla 22/3/15 p=0.32 Brent 31/2/5 p=1.3e-05 TOMS748 36/1/3 p=3.6e-08
+ defect + rem. + ORDER POINT Chandrupatla 20/3/17 p=0.74 Brent 30/2/6 p=7e-05 TOMS748 34/1/5 p=2.4e-06
+ G2 + contra + rem. + pt + EXP Chandrupatla 28/3/9 p=0.0026 Brent 31/3/4 p=3.5e-06 TOMS748 37/1/2 p=2.8e-09
+ defect + rem. + pt + EXP Chandrupatla 27/3/10 p=0.0076 Brent 30/2/6 p=7e-05 TOMS748 35/1/4 p=3.4e-07
CHA PER FAMILY (ours / Chandrupatla)
fun1 fun2 fun3 fun4 fun5 fun6 fun7 fun8 fun9
proposed rule 99 141 338 573 456 456 1000 52 105
+ G2 (step pattern) 97 146 346 522 456 456 1000 52 94
+ G2 + analogy entry 99 146 336 331 254 313 1000 52 94
+ contra + remembered analogy 108 141 304 318 254 275 1000 52 85
+ defect + remembered analogy 123 144 304 315 257 280 1000 57 81
+ G2 + analogy + ORDER POINT 82 146 230 261 100 256 1000 52 94
+ G2 + contra + rem. + ORDER PT 94 146 144 143 252 208 1000 52 80
+ defect + rem. + ORDER POINT 99 144 132 141 177 339 1000 57 75
+ G2 + contra + rem. + pt + EXP 98 146 147 158 208 187 1000 52 77
+ defect + rem. + pt + EXP 100 144 123 146 161 167 1000 57 74
Chandrupatla 103 152 305 297 233 233 1000 63 55