APS problems: 154

method                    strict solved/total    honest solved/total  disagreements
ours (shape)                153/154     2527         154/154     2337                 1
ours (dissimilar)           153/154     3123         154/154     2934                 1
ours (published proj)       153/154     2806         154/154     2634                 1
chandrupatla                153/154     2785         154/154     2593                 1
toms748                     153/154     2820         154/154     2636                 1
brent                       153/154     2889         154/154     2707                 1
itp                         153/154     3957         154/154     3767                 1
bisection                   153/154     7530         154/154     7338                 1

problems where the two criteria disagree (a root found, scored a failure):
   ours (shape)           aps.13.00    x=+0.008638489218 root=+0 f(x)=+0.000e+00 after 10 evals
   ours (dissimilar)      aps.13.00    x=+0.0248491106 root=+0 f(x)=+0.000e+00 after 11 evals
   ours (published proj)  aps.13.00    x=-0.01020453457 root=+0 f(x)=+0.000e+00 after 28 evals
   chandrupatla           aps.13.00    x=-0.008282706313 root=+0 f(x)=+0.000e+00 after 8 evals
   toms748                aps.13.00    x=-0.0002236853352 root=+0 f(x)=+0.000e+00 after 16 evals
   brent                  aps.13.00    x=+0.0154213326 root=+0 f(x)=+0.000e+00 after 18 evals
   itp                    aps.13.00    x=+0.03079215104 root=+0 f(x)=+0.000e+00 after 10 evals
   bisection              aps.13.00    x=+0.015625 root=+0 f(x)=+0.000e+00 after 8 evals

problems no method solved under the strict rule:
   aps.13.00    solved by 0 of 8 methods
   aps.01.00    solved by 8 of 8 methods
   aps.02.00    solved by 8 of 8 methods
   aps.02.01    solved by 8 of 8 methods
   aps.02.02    solved by 8 of 8 methods
   aps.02.03    solved by 8 of 8 methods

diagnosis of aps.13.00: bracket [-1, 4] declared root 0
   f(a)=-3.678794e-01  f(b)=+3.757652e+00  f(root)=+0.000000e+00
   f(root+1e-12) = +0.000000e+00   f(root-1e-12) = +0.000000e+00
   f(root+1e-09) = +0.000000e+00   f(root-1e-09) = +0.000000e+00
   f(root+1e-06) = +0.000000e+00   f(root-1e-06) = +0.000000e+00
   f(root+0.001) = +0.000000e+00   f(root-0.001) = +0.000000e+00
   ours returns x=+0.0248491106033 after 11 evals, f(x)=+0.000e+00, |x-root|=0.0248
   |f(x)| below smallest normal? True