Re: Two weeks to feature freeze

Dann Corbit wrote:
> That is the worst possible test plan. It totally lacks organization and
> there is no hint to define when the feature set has been covered. Ad
> hoc testing is a useful addition, but it cannot replace all the standard
> tests that have been used by the industry for decades.
>
> If you run literally hundreds of tests designed to ensure that your
> product conforms to ANSI/ISO standards then the bugs that are missed
> will be few and far between. Unless you are bad at designing tests.
>
> Designing tests is busywork. Desiging tests is boring. Nobody wants to
> design tests, let alone interpret the results and define correct
> baselines. But testing is very, very important.

I remember when I was with Great Bridge they said, "Oh, we are going to
have a test setup and do all sorts of testing to improve PostgreSQL." I
told them I doubted their testing was going to shake out many more bugs
than our existing testing setup, and you know what, I was pretty much
right. Sure, they found a few, but it wasn't much.

--
Bruce Momjian | http://candle.pha.pa.us
pgman(at)candle(dot)pha(dot)pa(dot)us | (610) 359-1001
+ If your life is a hard drive, | 13 Roberts Road
+ Christ can be your backup. | Newtown Square, Pennsylvania 19073