Re: [COMMITTERS] pgsql: Add ANALYZE into regression tests

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-hackers(at)postgresql(dot)org, Greg Stark <stark(at)mit(dot)edu>, Andrew Dunstan <andrew(at)dunslane(dot)net>, pgsql-committers(at)postgresql(dot)org
Subject: Re: [COMMITTERS] pgsql: Add ANALYZE into regression tests
Date: 2014-04-14 03:35:48
Message-ID: 20140414033548.GV2556@tamriel.snowman.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers pgsql-hackers

* Tom Lane (tgl(at)sss(dot)pgh(dot)pa(dot)us) wrote:
> Sure, but I think Greg's point is that this could be tested by a
> black-box functional test ("does it print something it shouldn't")
> rather than a white-box test that necessarily depends on a whole lot
> of *other* planner choices that don't have much to do with the point
> in question. You already got bit by variances in the choice of join
> type, which is not what the test is about.

Yes, but as I said, I'm *also* doing the black-box functional test..
Perhaps that means this extra EXPLAIN test is overkill, but, after
trying to run down whatever build animal 'hamerkop' has done to break
the tablespace regression test, I'm definitely keen to err on the side
of 'more information'.

> I think the test is okay as-is as long as we don't see more failures
> from it; but if we do see any more I'd suggest rewriting as per Greg's
> suggestion rather than trying to constrain the plan choice even more
> narrowly.

The 'rewriting', in this case, would simply be removing the 'explain'
part of the test and keeping the rest. If you or Greg see an issue with
the test that actually does the 'raise notice' for every value seen by
the 'snoop' function or it doesn't match your 'black-box' expectation,
please let me know and I can try to refine it..

Thanks,

Stephen

In response to

Browse pgsql-committers by date

  From Date Subject
Next Message Heikki Linnakangas 2014-04-14 11:55:58 pgsql: GIN entry pages follow the standard page layout - tell XLogInser
Previous Message Tom Lane 2014-04-14 03:28:22 Re: pgsql: Add ANALYZE into regression tests

Browse pgsql-hackers by date

  From Date Subject
Next Message Amit Kapila 2014-04-14 04:04:14 Re: PostgreSQL in Windows console and Ctrl-C
Previous Message Tom Lane 2014-04-14 03:28:22 Re: pgsql: Add ANALYZE into regression tests