| From: | Andrew Dunstan <andrew(at)dunslane(dot)net> |
|---|---|
| To: | Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> |
| Cc: | Marko Kreen <marko(at)l-t(dot)ee>, Jim Buttafuoco <jim(at)contactbda(dot)com>, Peter Eisentraut <peter_e(at)gmx(dot)net>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: CSV arm check failure |
| Date: | 2005-01-06 19:35:52 |
| Message-ID: | 41DD9318.7020504@dunslane.net |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
Tom Lane wrote:
>I have noticed an increasing tendency among the buildfarm crew to think
>that the regression tests should show zero diffs on all platforms no
>matter what. That is not the design goal. The intent is to tell you
>about possible problems. If you decide that a particular diff isn't
>really a problem, fine, but that doesn't mean we should mask the same
>symptom everywhere.
>
>
>
>
I don't want to mask anything that shouldn't be. I made the suggestion
in this particular case because we already have a number of alternative
result files caused by FP differences.
The buildfarm is a dashboard application - when everything is OK you
want it to show all green. If that's not a goal, then some redesign is
appropriate. Perhaps buildfarm needs its own test suite, rather than
leveraging those in the distribution, although that would be a pity, to
say the least.
cheers
andrew
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Marko Kreen | 2005-01-06 20:06:33 | Re: CSV arm check failure |
| Previous Message | Tom Lane | 2005-01-06 19:05:17 | Re: CSV arm check failure |