perf dir: old_1030_1300_run
rounds: [1, 2]
mjs = mergejoinscansel() time (timing builds); plan = Planning Time (no-timing builds); ms

== Plans and selectivities, master vs v4 (timing lines removed)
  all identical

== Scenario 1: plans and selectivities, master vs v4
  all identical

== Scenario 1: 12 runs per version, each after its own server start, Planning Time only
   per case: tmean over the runs (drop min and max, average the rest)
case  v4 path  plan master   plan v4   change  plan diff
   1     fast       2.4986    2.1139   -15.4%    -0.3847
   2     fast       0.2321    0.2335    +0.6%     0.0014
   3     fast       0.3890    0.2787   -28.4%    -0.1103
   4     fast       0.3036    0.2258   -25.6%    -0.0778
   5     fast       0.3187    0.2095   -34.3%    -0.1092
   6     fast       0.1933    0.1848    -4.4%    -0.0085
   7     fast       0.2551    0.2277   -10.7%    -0.0274
   8     fast       0.3610    0.2721   -24.6%    -0.0889
   9     fast       0.3835    0.2187   -43.0%    -0.1648
  10     fast       0.3811    0.2294   -39.8%    -0.1517
  11     fast       0.5883    0.5767    -2.0%    -0.0116
  12     fast       0.2439    0.2401    -1.6%    -0.0038
  13     fast       0.2347    0.2042   -13.0%    -0.0305
  14     fast       0.3569    0.3717    +4.1%     0.0148
  15     fast       0.8094    0.8519    +5.3%     0.0425
  16     fast       0.7118    0.6598    -7.3%    -0.0520
  17     slow       0.2513    0.6252  +148.8%     0.3739
  18     slow       0.3814    0.4226   +10.8%     0.0412
  19     slow       0.2814    0.3057    +8.6%     0.0243
  20     slow       0.3373    0.3513    +4.2%     0.0140
  21     slow       0.2277    0.2502    +9.9%     0.0225
  22     slow       0.2424    0.2388    -1.5%    -0.0036
  23    mixed       0.3513    0.3203    -8.8%    -0.0310
  24     slow       0.1394    0.1280    -8.2%    -0.0114
  25     slow       0.2256    0.2523   +11.8%     0.0267
  26     slow       0.2057    0.2052    -0.2%    -0.0005
  27     slow       0.3047    0.2930    -3.8%    -0.0117
  28     fast       0.3638    0.3562    -2.1%    -0.0076
  29     fast       0.1251    0.0966   -22.8%    -0.0285

== Scenario 1 summary: tmean over the cases of each group
  group cases  plan master   plan v4   change  plan diff
    all    29       0.3361    0.3235    -3.8%    -0.0126
   fast    18       0.3829    0.3338   -12.8%    -0.0491
   slow    10       0.2595    0.2899   +11.7%     0.0304
slow-17     9       0.2607    0.2709    +3.9%     0.0102
  mixed     1       0.3513    0.3203    -8.8%    -0.0310
  (v4 path from the timing runs of scenario 2; slow-17 = slow without case 17;
   groups with fewer than 3 cases use a plain mean)

== Scenario 2: each test.sql case run 128 times in one session
   per case: tmean over the 128 statements in each round, then mean over rounds
   group (master + v4): slow+fast = v4 always takes the shortcut, slow+slow = v4 never does, mixed = both
 case      group  v4 fast/slow  mjs master    mjs v4   change  plan master   plan v4   change  plan diff
    1  slow+fast         256/0      0.0369    0.0008   -97.8%       0.3158    0.2162   -31.6%    -0.0996
    2  slow+fast         256/0      0.0043    0.0010   -76.9%       0.1967    0.1940    -1.4%    -0.0027
    3  slow+fast         512/0      0.1379    0.0031   -97.7%       0.3743    0.2600   -30.5%    -0.1143
    4  slow+fast         256/0      0.0868    0.0020   -97.7%       0.3022    0.2155   -28.7%    -0.0866
    5  slow+fast         512/0      0.1440    0.0037   -97.4%       0.3538    0.2273   -35.8%    -0.1265
    6  slow+fast         256/0      0.0011    0.0012   +14.4%       0.1889    0.2101   +11.2%     0.0211
    7  slow+fast         256/0      0.0330    0.0008   -97.5%       0.2529    0.2147   -15.1%    -0.0382
    8  slow+fast         256/0      0.0358    0.0009   -97.6%       0.2513    0.2295    -8.7%    -0.0218
    9  slow+fast         256/0      0.0745    0.0016   -97.9%       0.3036    0.2289   -24.6%    -0.0747
   10  slow+fast         512/0      0.1412    0.0054   -96.2%       0.3495    0.2308   -34.0%    -0.1187
   11  slow+fast         256/0      0.0191    0.0009   -95.3%       0.2122    0.1959    -7.6%    -0.0162
   12  slow+fast         256/0      0.0330    0.0068   -79.4%       0.2248    0.1987   -11.6%    -0.0261
   13  slow+fast         256/0      0.0352    0.0008   -97.7%       0.2410    0.2035   -15.6%    -0.0375
   14  slow+fast         512/0      0.0116    0.0017   -85.1%       0.3576    0.3425    -4.2%    -0.0151
   15  slow+fast         256/0      0.0072    0.0009   -86.9%       0.1519    0.1449    -4.6%    -0.0070
   16  slow+fast         256/0      0.0069    0.0008   -87.8%       0.1302    0.1314    +1.0%     0.0013
   28  slow+fast         512/0      0.0022    0.0019   -12.1%       0.0814    0.0884    +8.6%     0.0070
   29  slow+fast         256/0      0.0067    0.0009   -85.8%       0.0887    0.0803    -9.4%    -0.0083
   17  slow+slow         0/256      0.0557    0.0562    +0.8%       0.2681    0.2698    +0.7%     0.0017
   18  slow+slow         0/256      0.0260    0.0255    -2.0%       0.1885    0.1862    -1.2%    -0.0023
   19  slow+slow         0/256      0.0007    0.0006   -10.2%       0.0728    0.0712    -2.3%    -0.0017
   20  slow+slow         0/256      0.0032    0.0034    +7.1%       0.2139    0.2204    +3.0%     0.0065
   21  slow+slow         0/256      0.0271    0.0257    -5.1%       0.2537    0.2768    +9.1%     0.0231
   22  slow+slow         0/256      0.0288    0.0247   -14.2%       0.2411    0.2659   +10.3%     0.0249
   24  slow+slow         0/256      0.0073    0.0071    -2.0%       0.1255    0.1198    -4.6%    -0.0058
   25  slow+slow         0/256      0.0080    0.0078    -3.4%       0.2100    0.2083    -0.8%    -0.0017
   26  slow+slow         0/256      0.0024    0.0022    -9.3%       0.2102    0.2466   +17.4%     0.0365
   27  slow+slow         0/256      0.0033    0.0032    -1.8%       0.2263    0.2269    +0.3%     0.0007
   23      mixed       512/256      0.0591    0.0298   -49.7%       0.3506    0.3302    -5.8%    -0.0204

== Scenario 2 summary: tmean over the cases of each group
     group round cases  mjs master    mjs v4   change  plan master   plan v4   change  plan diff
 slow+fast     1    18      0.0417    0.0017   -95.9%       0.2464    0.2038   -17.3%    -0.0426
 slow+fast     2    18      0.0423    0.0018   -95.8%       0.2426    0.1950   -19.6%    -0.0477
 slow+fast   avg    18      0.0420    0.0017   -95.9%       0.2451    0.1994   -18.6%    -0.0457
 slow+slow     1    10      0.0134    0.0126    -6.5%       0.2066    0.2246    +8.7%     0.0180
 slow+slow     2    10      0.0131    0.0124    -5.6%       0.2107    0.2094    -0.6%    -0.0012
 slow+slow   avg    10      0.0133    0.0125    -6.1%       0.2086    0.2180    +4.5%     0.0094
     mixed     1     1      0.0588    0.0321   -45.4%       0.3546    0.3439    -3.0%    -0.0106
     mixed     2     1      0.0594    0.0274   -53.8%       0.3466    0.3164    -8.7%    -0.0302
     mixed   avg     1      0.0591    0.0298   -49.7%       0.3506    0.3302    -5.8%    -0.0204
       all     1    29      0.0330    0.0062   -81.3%       0.2331    0.2141    -8.1%    -0.0190
       all     2    29      0.0332    0.0060   -81.9%       0.2322    0.2020   -13.0%    -0.0302
       all   avg    29      0.0331    0.0061   -81.6%       0.2330    0.2082   -10.6%    -0.0248
  (groups with fewer than 3 cases use a plain mean instead of tmean)

