perf dir: old_1030_1254_before_rerun
rounds: [1, 2]
mjs = mergejoinscansel() time (timing builds); plan = Planning Time (no-timing builds); ms

== Plans and selectivities, master vs v4 (timing lines removed)
  all identical

== Scenario 1: plans and selectivities, master vs v4
  all identical

== Scenario 1: 12 runs per version, each after its own server start, Planning Time only
   per case: tmean over the runs (drop min and max, average the rest)
case  v4 path  plan master   plan v4   change  plan diff
   1     fast       2.3600    2.0796   -11.9%    -0.2804
   2     fast       0.2464    0.2180   -11.5%    -0.0284
   3     fast       0.4066    0.2746   -32.5%    -0.1320
   4     fast       0.3158    0.2327   -26.3%    -0.0831
   5     fast       0.3380    0.2231   -34.0%    -0.1149
   6     fast       0.1966    0.1902    -3.3%    -0.0064
   7     fast       0.2449    0.2608    +6.5%     0.0159
   8     fast       0.2980    0.2477   -16.9%    -0.0503
   9     fast       0.3185    0.2430   -23.7%    -0.0755
  10     fast       0.3755    0.2515   -33.0%    -0.1240
  11     fast       0.6042    0.6157    +1.9%     0.0115
  12     fast       0.2520    0.2360    -6.3%    -0.0160
  13     fast       0.2498    0.2037   -18.5%    -0.0461
  14     fast       0.4279    0.3539   -17.3%    -0.0740
  15     fast       0.6881    0.6730    -2.2%    -0.0151
  16     fast       0.6582    0.6321    -4.0%    -0.0261
  17     slow       0.2646    0.5796  +119.0%     0.3150
  18     slow       0.4216    0.4069    -3.5%    -0.0147
  19     slow       0.3016    0.3026    +0.3%     0.0010
  20     slow       0.3818    0.3747    -1.9%    -0.0071
  21     slow       0.2482    0.2461    -0.8%    -0.0021
  22     slow       0.2416    0.2327    -3.7%    -0.0089
  23    mixed       0.3590    0.3125   -13.0%    -0.0465
  24     slow       0.1237    0.1248    +0.9%     0.0011
  25     slow       0.2357    0.2401    +1.9%     0.0044
  26     slow       0.2088    0.2176    +4.2%     0.0088
  27     slow       0.3294    0.3269    -0.8%    -0.0025
  28     fast       0.3737    0.3759    +0.6%     0.0022
  29     fast       0.1493    0.0986   -34.0%    -0.0507

== Scenario 1 summary: tmean over the cases of each group
  group cases  plan master   plan v4   change  plan diff
    all    29       0.3384    0.3184    -5.9%    -0.0200
   fast    18       0.3746    0.3270   -12.7%    -0.0476
   slow    10       0.2765    0.2934    +6.1%     0.0170
slow-17     9       0.2782    0.2772    -0.3%    -0.0009
  mixed     1       0.3590    0.3125   -13.0%    -0.0465
  (v4 path from the timing runs of scenario 2; slow-17 = slow without case 17;
   groups with fewer than 3 cases use a plain mean)

== Scenario 2: each test.sql case run 128 times in one session
   per case: tmean over the 128 statements in each round, then mean over rounds
   group (master + v4): slow+fast = v4 always takes the shortcut, slow+slow = v4 never does, mixed = both
 case      group  v4 fast/slow  mjs master    mjs v4   change  plan master   plan v4   change  plan diff
    1  slow+fast         256/0      0.0346    0.0008   -97.8%       0.2574    0.2030   -21.1%    -0.0544
    2  slow+fast         256/0      0.0040    0.0009   -77.1%       0.2019    0.1951    -3.4%    -0.0068
    3  slow+fast         512/0      0.1372    0.0030   -97.8%       0.3639    0.2160   -40.7%    -0.1480
    4  slow+fast         256/0      0.0718    0.0021   -97.0%       0.2972    0.2134   -28.2%    -0.0839
    5  slow+fast         512/0      0.1419    0.0035   -97.5%       0.3534    0.2098   -40.6%    -0.1436
    6  slow+fast         256/0      0.0011    0.0012    +8.2%       0.1971    0.1896    -3.8%    -0.0076
    7  slow+fast         256/0      0.0357    0.0008   -97.6%       0.2628    0.2071   -21.2%    -0.0557
    8  slow+fast         256/0      0.0361    0.0009   -97.6%       0.2574    0.2134   -17.1%    -0.0440
    9  slow+fast         256/0      0.0769    0.0016   -98.0%       0.2952    0.2276   -22.9%    -0.0676
   10  slow+fast         512/0      0.1412    0.0051   -96.4%       0.3533    0.2281   -35.4%    -0.1252
   11  slow+fast         256/0      0.0192    0.0009   -95.2%       0.2544    0.1956   -23.1%    -0.0589
   12  slow+fast         256/0      0.0326    0.0060   -81.5%       0.2262    0.1994   -11.9%    -0.0268
   13  slow+fast         256/0      0.0352    0.0009   -97.6%       0.2409    0.2039   -15.4%    -0.0370
   14  slow+fast         512/0      0.0107    0.0017   -84.3%       0.3581    0.3399    -5.1%    -0.0182
   15  slow+fast         256/0      0.0069    0.0010   -86.1%       0.1486    0.1396    -6.0%    -0.0090
   16  slow+fast         256/0      0.0071    0.0009   -87.2%       0.1303    0.1230    -5.6%    -0.0073
   28  slow+fast         512/0      0.0022    0.0018   -15.7%       0.0810    0.0781    -3.6%    -0.0029
   29  slow+fast         256/0      0.0065    0.0008   -87.6%       0.0855    0.0859    +0.5%     0.0004
   17  slow+slow         0/256      0.0553    0.0550    -0.5%       0.2714    0.2646    -2.5%    -0.0067
   18  slow+slow         0/256      0.0255    0.0250    -2.2%       0.1756    0.1771    +0.9%     0.0015
   19  slow+slow         0/256      0.0008    0.0007   -16.2%       0.0743    0.0718    -3.4%    -0.0025
   20  slow+slow         0/256      0.0033    0.0031    -5.1%       0.2017    0.2075    +2.9%     0.0058
   21  slow+slow         0/256      0.0268    0.0252    -6.1%       0.2477    0.2435    -1.7%    -0.0041
   22  slow+slow         0/256      0.0272    0.0257    -5.6%       0.2494    0.2409    -3.4%    -0.0085
   24  slow+slow         0/256      0.0073    0.0071    -2.7%       0.1200    0.1219    +1.5%     0.0018
   25  slow+slow         0/256      0.0077    0.0078    +0.7%       0.2087    0.2047    -1.9%    -0.0041
   26  slow+slow         0/256      0.0025    0.0022   -12.1%       0.2122    0.2107    -0.7%    -0.0014
   27  slow+slow         0/256      0.0033    0.0031    -5.5%       0.2186    0.2158    -1.3%    -0.0028
   23      mixed       512/256      0.0658    0.0268   -59.3%       0.3459    0.3338    -3.5%    -0.0121

== Scenario 2 summary: tmean over the cases of each group
     group round cases  mjs master    mjs v4   change  plan master   plan v4   change  plan diff
 slow+fast     1    18      0.0420    0.0017   -96.0%       0.2501    0.1887   -24.5%    -0.0614
 slow+fast     2    18      0.0401    0.0017   -95.7%       0.2376    0.1926   -18.9%    -0.0450
 slow+fast   avg    18      0.0411    0.0017   -95.9%       0.2450    0.1906   -22.2%    -0.0543
 slow+slow     1    10      0.0135    0.0122    -9.4%       0.2038    0.2036    -0.1%    -0.0003
 slow+slow     2    10      0.0124    0.0126    +1.1%       0.2046    0.2020    -1.3%    -0.0026
 slow+slow   avg    10      0.0130    0.0124    -4.4%       0.2042    0.2028    -0.7%    -0.0015
     mixed     1     1      0.0758    0.0268   -64.7%       0.3525    0.3364    -4.6%    -0.0161
     mixed     2     1      0.0558    0.0268   -51.9%       0.3394    0.3312    -2.4%    -0.0081
     mixed   avg     1      0.0658    0.0268   -59.3%       0.3459    0.3338    -3.5%    -0.0121
       all     1    29      0.0338    0.0059   -82.6%       0.2345    0.1973   -15.8%    -0.0372
       all     2    29      0.0316    0.0060   -81.1%       0.2273    0.1989   -12.5%    -0.0283
       all   avg    29      0.0327    0.0059   -81.9%       0.2316    0.1981   -14.4%    -0.0334
  (groups with fewer than 3 cases use a plain mean instead of tmean)

