perf dir: .
rounds: [1, 2]
mjs = mergejoinscansel() time (timing builds); plan = Planning Time (no-timing builds); ms

== Plans and selectivities, master vs v4 (timing lines removed)
  all identical

== Scenario 1: plans and selectivities, master vs v4
  all identical

== Scenario 1: 12 runs per version, each after its own server start, Planning Time only
   per case: tmean over the runs (drop min and max, average the rest)
case  v4 path  plan master   plan v4   change  plan diff
   1     fast       2.6384    2.1796   -17.4%    -0.4588
   2     fast       0.2300    0.2229    -3.1%    -0.0071
   3     fast       0.3821    0.2834   -25.8%    -0.0987
   4     fast       0.3159    0.2394   -24.2%    -0.0765
   5     fast       0.3188    0.2157   -32.3%    -0.1031
   6     fast       0.1992    0.1902    -4.5%    -0.0090
   7     fast       0.2526    0.2447    -3.1%    -0.0079
   8     fast       0.3292    0.2496   -24.2%    -0.0796
   9     fast       0.3235    0.2889   -10.7%    -0.0346
  10     fast       0.3700    0.2203   -40.5%    -0.1497
  11     fast       0.5837    0.5570    -4.6%    -0.0267
  12     fast       0.2360    0.2287    -3.1%    -0.0073
  13     fast       0.2362    0.2057   -12.9%    -0.0305
  14     fast       0.3703    0.3471    -6.3%    -0.0232
  15     fast       0.7501    0.6835    -8.9%    -0.0666
  16     fast       0.7204    0.6827    -5.2%    -0.0377
  17     slow       0.2730    0.5457   +99.9%     0.2727
  18     slow       0.4257    0.3919    -7.9%    -0.0338
  19     slow       0.2972    0.3236    +8.9%     0.0264
  20     slow       0.3350    0.3799   +13.4%     0.0449
  21     slow       0.2418    0.2678   +10.8%     0.0260
  22     slow       0.2339    0.2580   +10.3%     0.0241
  23    mixed       0.3502    0.3549    +1.3%     0.0047
  24     slow       0.1298    0.1428   +10.0%     0.0130
  25     slow       0.2458    0.2432    -1.1%    -0.0026
  26     slow       0.2288    0.1991   -13.0%    -0.0297
  27     slow       0.3158    0.3047    -3.5%    -0.0111
  28     fast       0.3665    0.3738    +2.0%     0.0073
  29     fast       0.1356    0.1064   -21.5%    -0.0292

== Scenario 1 summary: tmean over the cases of each group
  group cases  plan master   plan v4   change  plan diff
    all    29       0.3358    0.3202    -4.7%    -0.0156
   fast    18       0.3740    0.3271   -12.5%    -0.0469
   slow    10       0.2714    0.2960    +9.1%     0.0246
slow-17     9       0.2712    0.2823    +4.1%     0.0111
  mixed     1       0.3502    0.3549    +1.3%     0.0047
  (v4 path from the timing runs of scenario 2; slow-17 = slow without case 17;
   groups with fewer than 3 cases use a plain mean)

== Scenario 2: each test.sql case run 128 times in one session
   per case: tmean over the 128 statements in each round, then mean over rounds
   group (master + v4): slow+fast = v4 always takes the shortcut, slow+slow = v4 never does, mixed = both
 case      group  v4 fast/slow  mjs master    mjs v4   change  plan master   plan v4   change  plan diff
    1  slow+fast         256/0      0.0333    0.0009   -97.3%       0.2555    0.2225   -12.9%    -0.0330
    2  slow+fast         256/0      0.0045    0.0010   -77.2%       0.2178    0.1886   -13.4%    -0.0292
    3  slow+fast         512/0      0.1393    0.0036   -97.4%       0.3495    0.2205   -36.9%    -0.1290
    4  slow+fast         256/0      0.0713    0.0020   -97.1%       0.3054    0.2158   -29.3%    -0.0895
    5  slow+fast         512/0      0.1454    0.0041   -97.2%       0.3358    0.2199   -34.5%    -0.1158
    6  slow+fast         256/0      0.0012    0.0013    +5.2%       0.1950    0.1938    -0.6%    -0.0012
    7  slow+fast         256/0      0.0327    0.0009   -97.3%       0.2676    0.2167   -19.0%    -0.0509
    8  slow+fast         256/0      0.0365    0.0009   -97.6%       0.2582    0.2131   -17.5%    -0.0451
    9  slow+fast         256/0      0.0751    0.0017   -97.8%       0.3067    0.2271   -26.0%    -0.0796
   10  slow+fast         512/0      0.1405    0.0050   -96.5%       0.3825    0.2327   -39.2%    -0.1498
   11  slow+fast         256/0      0.0209    0.0009   -95.5%       0.2190    0.1938   -11.5%    -0.0252
   12  slow+fast         256/0      0.0328    0.0066   -80.0%       0.2373    0.2024   -14.7%    -0.0349
   13  slow+fast         256/0      0.0340    0.0008   -97.6%       0.2643    0.2022   -23.5%    -0.0621
   14  slow+fast         512/0      0.0117    0.0016   -86.5%       0.3441    0.3383    -1.7%    -0.0058
   15  slow+fast         256/0      0.0069    0.0010   -85.0%       0.1417    0.1426    +0.6%     0.0009
   16  slow+fast         256/0      0.0071    0.0008   -88.4%       0.1366    0.1272    -6.9%    -0.0095
   28  slow+fast         512/0      0.0018    0.0017    -7.3%       0.0881    0.0818    -7.2%    -0.0064
   29  slow+fast         256/0      0.0074    0.0008   -88.8%       0.1063    0.0804   -24.4%    -0.0259
   17  slow+slow         0/256      0.0582    0.0535    -8.0%       0.2653    0.2919   +10.0%     0.0266
   18  slow+slow         0/256      0.0237    0.0254    +7.5%       0.1743    0.1811    +3.9%     0.0068
   19  slow+slow         0/256      0.0008    0.0007   -11.3%       0.0825    0.0740   -10.3%    -0.0085
   20  slow+slow         0/256      0.0034    0.0032    -5.8%       0.2085    0.2088    +0.2%     0.0003
   21  slow+slow         0/256      0.0258    0.0267    +3.5%       0.2435    0.2558    +5.1%     0.0124
   22  slow+slow         0/256      0.0260    0.0259    -0.4%       0.2639    0.2459    -6.8%    -0.0180
   24  slow+slow         0/256      0.0074    0.0073    -0.2%       0.1204    0.1247    +3.6%     0.0043
   25  slow+slow         0/256      0.0086    0.0075   -12.9%       0.2202    0.2148    -2.4%    -0.0054
   26  slow+slow         0/256      0.0024    0.0023    -3.9%       0.2128    0.2174    +2.2%     0.0047
   27  slow+slow         0/256      0.0035    0.0033    -3.8%       0.2177    0.2209    +1.5%     0.0032
   23      mixed       512/256      0.0670    0.0300   -55.3%       0.3453    0.3267    -5.4%    -0.0187

== Scenario 2 summary: tmean over the cases of each group
     group round cases  mjs master    mjs v4   change  plan master   plan v4   change  plan diff
 slow+fast     1    18      0.0424    0.0018   -95.7%       0.2501    0.1964   -21.5%    -0.0537
 slow+fast     2    18      0.0391    0.0017   -95.6%       0.2425    0.1911   -21.2%    -0.0513
 slow+fast   avg    18      0.0410    0.0018   -95.7%       0.2463    0.1938   -21.3%    -0.0525
 slow+slow     1    10      0.0129    0.0124    -4.1%       0.2096    0.2146    +2.4%     0.0050
 slow+slow     2    10      0.0122    0.0130    +6.4%       0.2039    0.2026    -0.6%    -0.0013
 slow+slow   avg    10      0.0126    0.0127    +1.0%       0.2076    0.2087    +0.5%     0.0010
     mixed     1     1      0.0749    0.0297   -60.3%       0.3465    0.3222    -7.0%    -0.0243
     mixed     2     1      0.0592    0.0303   -48.9%       0.3442    0.3312    -3.8%    -0.0130
     mixed   avg     1      0.0670    0.0300   -55.3%       0.3453    0.3267    -5.4%    -0.0187
       all     1    29      0.0339    0.0061   -82.0%       0.2364    0.2052   -13.2%    -0.0312
       all     2    29      0.0312    0.0063   -79.8%       0.2304    0.1999   -13.2%    -0.0304
       all   avg    29      0.0327    0.0062   -81.0%       0.2334    0.2026   -13.2%    -0.0308
  (groups with fewer than 3 cases use a plain mean instead of tmean)

