  OK   number of configurations                                   got              264  want 264

The proposed method (projection, multiplier declared):
  OK   APS place                                                  got                3  want 3
  OK   APS total                                                  got             2806  want 2806
  OK   APS solved                                                 got              153  want 153
  OK   CHA place                                                  got               47  want 47
  OK   CHA total                                                  got             3220  want 3220
  OK   CHA solved                                                 got               40  want 40
  OK   both sets                                                  got             6026  want 6026

Head to head of the proposed method:
  OK   APS vs chandrupatla                                        got     (87, 24, 42)  want (87, 24, 42)
  OK   APS vs toms748                                             got     (86, 16, 51)  want (86, 16, 51)
  OK   APS vs brent                                               got    (102, 11, 40)  want (102, 11, 40)
  OK   APS vs itp                                                 got     (132, 3, 18)  want (132, 3, 18)
  OK   APS vs itp_oracle                                          got     (121, 4, 28)  want (121, 4, 28)
  OK   APS vs bisection                                           got      (152, 1, 0)  want (152, 1, 0)
  OK   CHA vs chandrupatla                                        got       (9, 5, 26)  want (9, 5, 26)
  OK   CHA vs toms748                                             got       (31, 1, 8)  want (31, 1, 8)
  OK   CHA vs brent                                               got       (30, 4, 4)  want (30, 4, 4)
  OK   CHA vs itp                                                 got      (17, 0, 23)  want (17, 0, 23)
  OK   CHA vs itp_oracle                                          got      (16, 0, 24)  want (16, 0, 24)
  OK   APS vs Chandrupatla sign test p < 1e-4                     got             True  want True
  OK   CHA vs Chandrupatla sign test p (rounded)                  got            0.006  want 0.006

The constant-free variant (earned projection):
  OK   credit APS place                                           got               29  want 29
  OK   credit APS total                                           got             3568  want 3568
  OK   credit CHA place                                           got               10  want 10
  OK   credit CHA total                                           got             3020  want 3020
  OK   credit both sets                                           got             6588  want 6588
  OK   credit costs 762 more on the canonical set                 got              762  want 762
  OK   credit APS vs chandrupatla                                 got      (79, 3, 71)  want (79, 3, 71)
  OK   credit APS vs toms748                                      got      (77, 9, 67)  want (77, 9, 67)
  OK   credit APS vs brent                                        got      (78, 5, 70)  want (78, 5, 70)
  OK   credit APS vs Chandrupatla sign test p (rounded)           got             0.57  want 0.57

The guards that replace the step instead of projecting it:
  OK   APS unguarded                                              got             2806  want 2806
  OK   CHA unguarded total                                        got             4104  want 4104
  OK   CHA unguarded solved                                       got               35  want 35
  OK   CHA unguarded bound violations                             got               10  want 10
  OK   APS bracket-guard                                          got             7260  want 7260
  OK   APS both-guard                                             got             7239  want 7239

Alefeld-Potra-Shi:
  OK   APS winner                                                 got   'chandrupatla'  want 'chandrupatla'
  OK   APS chandrupatla place                                     got                1  want 1
  OK   APS chandrupatla total                                     got             2787  want 2787
  OK   APS toms748 place                                          got                4  want 4
  OK   APS toms748 total                                          got             2820  want 2820
  OK   APS brent place                                            got                5  want 5
  OK   APS brent total                                            got             2889  want 2889
  OK   APS dekker place                                           got               12  want 12
  OK   APS dekker total                                           got             3158  want 3158
  OK   APS itp_oracle place                                       got               13  want 13
  OK   APS itp_oracle total                                       got             3260  want 3260
  OK   APS ridders place                                          got               20  want 20
  OK   APS ridders total                                          got             3313  want 3313
  OK   APS itp place                                              got               34  want 34
  OK   APS itp total                                              got             3957  want 3957
  OK   APS illinois place                                         got               73  want 73
  OK   APS illinois total                                         got             7045  want 7045
  OK   APS bisection place                                        got               79  want 79
  OK   APS bisection total                                        got             7530  want 7530
  OK   APS regula_falsi place                                     got              244  want 244
  OK   APS regula_falsi total                                     got            10560  want 10560
  OK   APS regula falsi solved                                    got              127  want 127

Chandrupatla:
  OK   CHA rank 1 label                                           got 'pure.sqrt.bracket.project'  want 'pure.sqrt.bracket.project'
  OK   CHA rank 1 solves one more than anyone else                got               41  want 41
  OK   CHA chandrupatla place                                     got                2  want 2
  OK   CHA chandrupatla total                                     got             2441  want 2441
  OK   CHA itp_oracle place                                       got                3  want 3
  OK   CHA itp_oracle total                                       got             2611  want 2611
  OK   CHA itp place                                              got                6  want 6
  OK   CHA itp total                                              got             2857  want 2857
  OK   CHA bisection place                                        got               16  want 16
  OK   CHA bisection total                                        got             3090  want 3090
  OK   CHA toms748 place                                          got              164  want 164
  OK   CHA toms748 total                                          got             4000  want 4000
  OK   CHA brent place                                            got              226  want 226
  OK   CHA brent total                                            got             4115  want 4115
  OK   CHA brent solved                                           got               38  want 38
  OK   chandrupatla, both sets                                    got             5228  want 5228
  OK   Chandrupatla beats us on both sets                         got             True  want True

Negative results, the regime claims:
  OK   CHA cbrt over the whole set                                got             4099  want 4099
  OK   single fixed choice, both sets                             got             6026  want 6026
  OK   switch by benchmark set, both sets                         got             6905  want 6905
  OK   switching is worse than not switching                      got             True  want True
  OK   fun4.1 projection variant                                  got               89  want 89
  OK   fun4.1 cbrt                                                got               32  want 32
  OK   fun4.2 projection variant                                  got               93  want 93
  OK   fun4.2 cbrt                                                got               32  want 32
  OK   fun4.3 projection variant                                  got              113  want 113
  OK   fun4.3 cbrt                                                got               40  want 40
  OK   fun4.4 projection variant                                  got              125  want 125
  OK   fun4.4 cbrt                                                got               47  want 47
  OK   fun4.5 projection variant                                  got              153  want 153
  OK   fun4.5 cbrt                                                got               59  want 59

The law across the grid:
  OK   mean total, scale=derived3, lin                            got             6809  want 6809
  OK   mean total, scale=derived3, quad                           got            22294  want 22294
  OK   mean total, scale=derived, lin                             got             6906  want 6906
  OK   mean total, scale=derived, quad                            got            22167  want 22167
  OK   mean total, scale=bracket, lin                             got            10263  want 10263
  OK   mean total, scale=bracket, quad                            got            19137  want 19137
  OK   mean total, scale=start, lin                               got            16102  want 16102
  OK   mean total, scale=start, quad                              got            15345  want 15345
  OK   every c=1 similarity beats every c=0 similarity            got             True  want True
  OK   similarity ranking                                         got ['ratio', 'exp_abs', 'rational', 'ratio_soft', 'sqrt', 'cbrt', 'exp_sq', 'rat_sq', 'cosine']  want ['ratio', 'exp_abs', 'rational', 'ratio_soft', 'sqrt', 'cbrt', 'exp_sq', 'rat_sq', 'cosine']
  OK   similarity ratio best                                      got             6496  want 6496
  OK   similarity exp_abs best                                    got             6822  want 6822
  OK   similarity rational best                                   got             7038  want 7038
  OK   similarity ratio_soft best                                 got             9502  want 9502
  OK   similarity sqrt best                                       got            10497  want 10497
  OK   similarity cbrt best                                       got            11941  want 11941
  OK   similarity exp_sq best                                     got            14314  want 14314
  OK   similarity rat_sq best                                     got            15102  want 15102
  OK   similarity cosine best                                     got            16394  want 16394
  OK   scale ranking                                              got ['derived3', 'derived', 'bracket', 'start']  want ['derived3', 'derived', 'bracket', 'start']
  OK   scale derived3 best                                        got             6496  want 6496
  OK   scale derived best                                         got             6628  want 6628
  OK   scale bracket best                                         got             9081  want 9081
  OK   scale start best                                           got            14540  want 14540

The placement modes (each in its own sweep file):
  OK   slope.ratio.derived3.project APS                           got             2848  want 2848
  OK   slope.ratio.derived3.project CHA                           got             3074  want 3074
  OK   slope.ratio.derived3.project solved                        got              193  want 193
  OK   slope.ratio.derived3.project guarantee (over 2x)           got                0  want 0
  OK   pure+shape+slope.ratio.derived3.safe APS                   got             2527  want 2527
  OK   pure+shape+slope.ratio.derived3.safe CHA                   got             3108  want 3108
  OK   pure+shape+slope.ratio.derived3.safe solved                got              193  want 193
  OK   pure+shape+slope.ratio.derived3.safe guarantee (over 2x)   got                0  want 0
  OK   pure+dissim+slope.ratio.derived3.project APS               got             2726  want 2726
  OK   pure+dissim+slope.ratio.derived3.project CHA               got             2785  want 2785
  OK   pure+dissim+slope.ratio.derived3.project solved            got              193  want 193
  OK   pure+dissim+slope.ratio.derived3.project guarantee (over 2x) got                0  want 0
  OK   pure+shape+dissim+slope.ratio.derived3.safe APS            got             2884  want 2884
  OK   pure+shape+dissim+slope.ratio.derived3.safe CHA            got             2859  want 2859
  OK   pure+shape+dissim+slope.ratio.derived3.safe solved         got              193  want 193
  OK   pure+shape+dissim+slope.ratio.derived3.safe guarantee (over 2x) got                0  want 0
  OK   gate.ratio.derived.project APS                             got             4449  want 4449
  OK   gate.ratio.derived.project CHA                             got             2991  want 2991
  OK   gate.ratio.derived.project solved                          got              193  want 193
  OK   gate.ratio.derived.project guarantee (over 2x)             got                0  want 0
  OK   log.ratio_soft.derived.safe APS                            got             6940  want 6940
  OK   log.ratio_soft.derived.safe CHA                            got             3474  want 3474
  OK   log.ratio_soft.derived.safe solved                         got              193  want 193
  OK   log.ratio_soft.derived.safe guarantee (over 2x)            got                0  want 0
  OK   pure+dissim+slope.ratio.derived3.safe CHA per-set          got             2683  want 2683
  OK   gate.ratio_soft.derived.safe CHA per-set                   got             2851  want 2851

The per-place reading (sweep_order.json):
  OK   far+rational both APS m=1                                  got             4522  want 4522
  OK   far+rational both APS order                                got             3675  want 3675
  OK   far+rational both CHA m=1                                  got             3387  want 3387
  OK   far+rational both CHA order                                got             3216  want 3216
  OK   far+rational bracket APS m=1                               got             4606  want 4606
  OK   far+rational bracket APS order                             got             3542  want 3542
  OK   far+rational bracket CHA m=1                               got             3571  want 3571
  OK   far+rational bracket CHA order                             got             3303  want 3303
  OK   far+rational credit APS m=1                                got             5190  want 5190
  OK   far+rational credit APS order                              got             4686  want 4686
  OK   far+rational credit CHA m=1                                got             3013  want 3013
  OK   far+rational credit CHA order                              got             2884  want 2884
  OK   far+rational project APS m=1                               got             6932  want 6932
  OK   far+rational project APS order                             got             6364  want 6364
  OK   far+rational project CHA m=1                               got             4794  want 4794
  OK   far+rational project CHA order                             got             4559  want 4559
  OK   far+rational safe APS m=1                                  got             5987  want 5987
  OK   far+rational safe APS order                                got             5229  want 5229
  OK   far+rational safe CHA m=1                                  got             4108  want 4108
  OK   far+rational safe CHA order                                got             3923  want 3923
  OK   far+rational step APS m=1                                  got             6435  want 6435
  OK   far+rational step APS order                                got             5551  want 5551
  OK   far+rational step CHA m=1                                  got             4257  want 4257
  OK   far+rational step CHA order                                got             4022  want 4022
  OK   far+rational none APS m=1                                  got            10676  want 10676
  OK   far+rational none APS order                                got            10043  want 10043
  OK   far+rational none CHA m=1                                  got             8265  want 8265
  OK   far+rational none CHA order                                got             7794  want 7794
  OK   cheaper in 7 of 7 safeguards                               got                7  want 7
  OK   false position none solved                                 got              127  want 127
  OK   false position none APS                                    got            10676  want 10676
  OK   false position order solved                                got              128  want 128
  OK   false position order APS                                   got            10043  want 10043
  OK   slope reading none APS                                     got             2806  want 2806
  OK   slope reading order APS                                    got             2854  want 2854
  OK   guarantee family violations                                got                0  want 0

The decision place (sweep_decision.json):
  OK   ratio.band.project APS                                     got             5432  want 5432
  OK   ratio.band.project CHA                                     got             3066  want 3066
  OK   ratio.band.credit CHA                                      got             2899  want 2899
  OK   ratio.none.project APS                                     got             2806  want 2806
  OK   ratio.defect.project APS                                   got             2523  want 2523
  OK   ratio.defect.project CHA                                   got             3210  want 3210
  OK   ratio_soft.simpair.project CHA                             got             2868  want 2868
  OK   defect APS solved                                          got              153  want 153
  OK   defect both sets                                           got             5733  want 5733
  OK   defect is the new canonical best (< 2527)                  got             True  want True
  OK   decision grid guarantee violations                         got                0  want 0
  OK   band refusal rate %                                        got             63.6  want 63.6
  OK   defect refusal rate %                                      got              7.0  want 7.0

The gap decomposition (fresh runs of the diagnosis scripts):
  OK   problems where we lose                                     got               33  want 33
  OK   fun1.4 our bracket halvings/eval                           got             0.62  want 0.62
  OK   fun1.4 IQI from our points                                 got            10.37  want 10.37
  OK   flat: ours min                                             got             0.41  want 0.41
  OK   flat: ours max                                             got             0.81  want 0.81
  OK   flat: IQI min                                              got             0.01  want 0.01
  OK   flat: IQI max                                              got             0.17  want 0.17
  OK   non-degenerate states with one negative weight             got    np.int64(428)  want 428
  OK   bracketing states in total                                 got              433  want 433
  OK   every exception is an underflowed zero weight              got             True  want True
  OK   total gap on the losing problems                           got              244  want 244
  OK   flat families' gap                                         got              160  want 160
  OK   fun1 gap                                                   got               58  want 58
  OK   Chandrupatla bisect share fun3 %                           got               92  want 92
  OK   Chandrupatla bisect share fun4 %                           got               96  want 96
  OK   Chandrupatla bisect share fun5 %                           got              100  want 100
  OK   Chandrupatla bisect share fun6 %                           got              100  want 100
  OK   Chandrupatla total fun4                                    got              297  want 297
  OK   Chandrupatla total fun5                                    got              233  want 233
  OK   Chandrupatla total fun6                                    got              233  want 233
  OK   m>=2 on canonical states %                                 got  np.float64(0.2)  want 0.2
  OK   m>=2 on flat states %                                      got              5.8  want 5.8
  OK   band fun4 no-gate                                          got              573  want 573
  OK   band fun4 with band                                        got              296  want 296
  OK   band fun5 no-gate                                          got              456  want 456
  OK   band fun5 with band                                        got              239  want 239
  OK   band fun6 no-gate                                          got              456  want 456
  OK   band fun6 with band                                        got              235  want 235
  OK   band cost on fun1                                          got              164  want 164
  OK   band cost on fun2                                          got              111  want 111
  OK   band cost on fun8                                          got              170  want 170
  OK   band cost on fun9                                          got              144  want 144
  OK   log item: x-space control APS                              got             5822  want 5822
  OK   log item: x-space control CHA                              got             3643  want 3643

§3.1: the multiplier and the endowment (fresh runs):
  OK   multiplier 1.0 APS                                         got             4817  want 4817
  OK   multiplier 1.0 CHA                                         got             2997  want 2997
  OK   multiplier 1.25 APS                                        got             2806  want 2806
  OK   multiplier 1.25 CHA                                        got             2752  want 2752
  OK   multiplier 1.5 APS                                         got             2806  want 2806
  OK   multiplier 1.5 CHA                                         got             2889  want 2889
  OK   multiplier 2.0 APS                                         got             2806  want 2806
  OK   multiplier 2.0 CHA                                         got             3220  want 3220
  OK   multiplier 3.0 APS                                         got             2806  want 2806
  OK   multiplier 3.0 CHA                                         got             3756  want 3756
  OK   multiplier 4.0 APS                                         got             2806  want 2806
  OK   multiplier 4.0 CHA                                         got             4006  want 4006
  OK   endowment 0.1 APS                                          got             5344  want 5344
  OK   endowment 0.1 CHA                                          got             3051  want 3051
  OK   endowment 0.5 APS                                          got             4656  want 4656
  OK   endowment 0.5 CHA                                          got             3002  want 3002
  OK   endowment 1.0 APS                                          got             3568  want 3568
  OK   endowment 1.0 CHA                                          got             3020  want 3020
  OK   endowment 2.0 APS                                          got             3692  want 3692
  OK   endowment 2.0 CHA                                          got             2712  want 2712
  OK   endowment 5.0 APS                                          got             3006  want 3006
  OK   endowment 5.0 CHA                                          got             2615  want 2615
  OK   C0=1 cheapest within the one-step promise                  got              1.0  want 1.0
  OK   2527 at multiplier 1.25                                    got             2541  want 2541
  OK   2527 flat from 1.5 to 4                                    got           {2527}  want {2527}
  OK   2523 flat from 1.25 to 4                                   got           {2523}  want {2523}

Tables 2-3 regenerated:
  OK   APS pure.ratio.derived3.project place                      got                3  want 3
  OK   APS pure.ratio.derived3.none place                         got                2  want 2
  OK   CHA pure.ratio.derived3.project place                      got               47  want 47
  OK   CHA pure.ratio.derived3.none place                         got              228  want 228
  OK   CHA pure.exp_abs.bracket.both place                        got                4  want 4
  OK   CHA exp_abs.bracket.both total                             got             2733  want 2733
  OK   CHA TOMS 748 over the 2x bound                             got               15  want 15
  OK   CHA Brent over the 2x bound                                got               18  want 18
  OK   credit APS vs itp_oracle                                   got      (86, 6, 61)  want (86, 6, 61)
  OK   credit CHA vs itp_oracle                                   got       (2, 3, 35)  want (2, 3, 35)
  OK   credit CHA vs bisection                                    got       (5, 0, 35)  want (5, 0, 35)
  OK   project APS vs chandrupatla                                got     (87, 24, 42)  want (87, 24, 42)
  OK   project APS vs itp                                         got     (132, 3, 18)  want (132, 3, 18)
  OK   project APS vs itp_oracle                                  got     (121, 4, 28)  want (121, 4, 28)
  OK   project APS vs bisection                                   got      (152, 1, 0)  want (152, 1, 0)
  OK   project CHA vs toms748                                     got       (31, 1, 8)  want (31, 1, 8)
  OK   project CHA vs brent                                       got       (30, 4, 4)  want (30, 4, 4)
  OK   project CHA vs itp                                         got      (17, 0, 23)  want (17, 0, 23)
  OK   project CHA vs itp_oracle                                  got      (16, 0, 24)  want (16, 0, 24)
  OK   both sets pure.ratio.derived3.credit                       got             6588  want 6588
  OK   both sets pure.ratio.derived3.project                      got             6026  want 6026
  OK   both sets chandrupatla                                     got             5228  want 5228
  OK   both sets itp_oracle                                       got             5871  want 5871
  OK   both sets toms748                                          got             6820  want 6820
  OK   both sets brent                                            got             7004  want 7004

§7 under the earned projection:
  OK   slope.ratio.derived3.credit APS                            got             3507  want 3507
  OK   slope.ratio.derived3.credit CHA                            got             2997  want 2997
  OK   pure+shape+slope.ratio.derived3.credit APS                 got             3755  want 3755
  OK   pure+shape+slope.ratio.derived3.credit CHA                 got             3021  want 3021
  OK   pure+dissim+slope.ratio.derived3.credit APS                got             3857  want 3857
  OK   pure+dissim+slope.ratio.derived3.credit CHA                got             3002  want 3002
  OK   pure+shape+dissim+slope.ratio.derived3.credit APS          got             4354  want 4354
  OK   pure+shape+dissim+slope.ratio.derived3.credit CHA          got             3037  want 3037
  OK   defect.ratio.derived3.credit APS                           got             3545  want 3545
  OK   defect.ratio.derived3.credit CHA                           got             2949  want 2949
  OK   best constant-free configuration                           got 'defect.ratio.derived3.credit'  want 'defect.ratio.derived3.credit'
  OK   its total over both sets                                   got             6494  want 6494

every number stated in the paper matches the sweep data.
