diff --git a/article/sim_numerics.md b/article/sim_numerics.md index 1cf8f7c..286bfa1 100644 --- a/article/sim_numerics.md +++ b/article/sim_numerics.md @@ -22,7 +22,7 @@ This paper asks a different question. Suppose the only thing available is a *sim The answer is sharp in both directions, and the negative half is as informative as the positive half. -The paper proceeds in two stages. Sections 2–7 derive a base rule from the similarity alone, measure it, and locate what it lacks: not a better model but a decision, when to stop trusting the model it has. Section 8 supplies that decision with a similarity of the run to its own past, and Section 9 tests the resulting method on four corpora it was not developed on, one of them fixed after the method's code was frozen. +The paper proceeds in two stages. Sections 2–7 derive a base rule from the similarity alone, measure it, and locate what it lacks: not a better model but a decision, when to stop trusting the model it has. Section 8 supplies that decision with a similarity of the run to its own past, and Section 9 tests it on four further corpora: three of them exposed two last gaps of the base step and were used to close them, and the fourth was fixed after the method's code was frozen and run once. --- @@ -423,7 +423,7 @@ Nearness of configurations is one relation. An analogy in the full sense needs a $$m=\frac{\ln L_f}{\ln L_x}.\tag{6}$$ -Under an exact zoom a pure power of order $m$ reads exactly $m$; along a real run the analogous pairs are only nearly homothetic and the reading scatters about the order, but the regime asks only whether it reaches 2. The regime is the one where a tangent step loses, $m\ge2$ (§8.1) — no new constant. On the traces of the base rule, at the moments the flag rises, the three conditions together hold on 3 of the 154 canonical problems, on all 20 flat problems, and on none of `fun2`, `fun8`, `fun9`. +Under an exact zoom a pure power of order $m$ reads exactly $m$; along a real run the analogous pairs are only nearly homothetic and the reading scatters about the order, but the regime asks only whether it reaches 2, the order from which a tangent step loses to a halving (§8.1) — no new constant. On the traces of the base rule, at the moments the flag rises, the three conditions together hold on 3 of the 154 canonical problems, on all 20 flat problems, and on none of `fun2`, `fun8`, `fun9`. **The analogy belongs to the run, the flag to the moment.** In the cycle the base rule runs on a pure power — undershoot, undershoot, crossing, a nearly empty step — the flag rises in the phases whose configuration does *not* recur (the empty step grows emptier every cycle), while the recurring phases have the flag down. Requiring both in one state delayed the entry on the flat problems to their thirteenth state on average. Once established, the analogy is therefore remembered for the run, and the regime is entered at the next unkept promise (eighth state on average). diff --git a/results_verify_article.txt b/results_verify_article.txt index ce92216..07e468e 100644 --- a/results_verify_article.txt +++ b/results_verify_article.txt @@ -439,5 +439,15 @@ Section 9 (out-of-sample corpora): OK Roots.jl, variant carried: totals got (1464, 1566) want (1464, 1566) OK Roots.jl, variant carried: per problem got (38, 10, 30) want (38, 10, 30) OK applied, variant carried: totals got (1580, 1382) want (1580, 1382) + OK sign test p for 103:31 got '3e-10' want '3e-10' + OK sign test p for 31:10 got '0.001' want '0.001' + OK sign test p for 108:65 got '0.001' want '0.001' + OK sign test p for 44:20 got '0.004' want '0.004' + OK sign test p for 48:32 got '0.09' want '0.09' + OK sign test p for 177:28 got '1e-27' want '1e-27' + OK sign test p for 107:22 got '1e-14' want '1e-14' + OK sign test p for 43:15 got '0.0003' want '0.0003' + OK sign test p for 105:67 got '0.005' want '0.005' + OK sign test p for 38:30 got '0.4' want '0.4' every number stated in the paper matches the sweep data. diff --git a/verify_article.py b/verify_article.py index 34480fb..b9603f4 100644 --- a/verify_article.py +++ b/verify_article.py @@ -800,6 +800,12 @@ def verify_flat_regime_and_oos(): check("applied, variant carried: totals", (sum(cost(v) for v in app["A"].values()), sum(cost(v) for v in app["chandrupatla"].values())), (1580, 1382)) + # every sign-test p the paper prints in Section 9, at the precision printed + for (w, l), printed in (((103, 31), "3e-10"), ((31, 10), "0.001"), ((108, 65), "0.001"), + ((44, 20), "0.004"), ((48, 32), "0.09"), ((177, 28), "1e-27"), + ((107, 22), "1e-14"), ((43, 15), "0.0003"), ((105, 67), "0.005"), + ((38, 30), "0.4")): + check(f"sign test p for {w}:{l}", f"{sign_p(w, l):.1g}", printed) if __name__ == "__main__":