vvs/sim-numerics
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

chasing Chandrupatla found a property of the BENCHMARK: on all five fun7 problems f vanishes identically near the declared root (f(0+t)=0 up to 3.2e-2), every method stops at a point where f(x)=0 exactly and is scored a failure by the |x-root|<=1e-6 rule — so 1000 evaluations of EVERY wide-bracket total are an artefact and the universal '40 of 45' is a scoring statement. Re-scored: 45/45 for everyone but Brent, ranking unchanged, gap to Chandrupatla 253 (17%) and diffuse across 8 families. Written into the paper with its reproducing scripts; pdflatex clean, verifier green

Browse Source 
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
vvs
2026-09-20 23:57:49 +01:00
co-authored by Claude Opus 5
parent ee816933eb
commit 6b5870f815
9 changed files with 467 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
results_rescore_cha.txt
+29
View File
@@ -0,0 +1,29 @@
method strict: solved/total honest: solved/total fun7 strict fun7 honest
ours (shape) 40/45 3108 45/45 2159 0/5 5/5
ours (dissimilar) 40/45 2683 45/45 1740 0/5 5/5
ours (published proj) 40/45 3220 45/45 2357 0/5 5/5
chandrupatla 40/45 2423 45/45 1487 0/5 5/5
toms748 40/45 4000 45/45 3088 0/5 5/5
brent 38/45 4099 43/45 3222 0/5 5/5
itp 40/45 2857 45/45 1907 0/5 5/5
bisection 40/45 3090 45/45 2136 0/5 5/5
ranking under the HONEST criterion (fewest unsolved, then evaluations):
chandrupatla 45/45 1487
ours (dissimilar) 45/45 1740
itp 45/45 1907
bisection 45/45 2136
ours (shape) 45/45 2159
ours (published proj) 45/45 2357
toms748 45/45 3088
brent 43/45 3222
ranking under the STRICT criterion, for comparison:
chandrupatla 40/45 2423
ours (dissimilar) 40/45 2683
itp 40/45 2857
bisection 40/45 3090
ours (shape) 40/45 3108
ours (published proj) 40/45 3220
toms748 40/45 4000
brent 38/45 4099