Re: [HACKERS] DISTINCT ON: speak now or forever hold your peace

From: Mike Mascari <mascarm(at)mascari(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-hackers(at)postgreSQL(dot)org, pgsql-sql(at)postgreSQL(dot)org
Subject: Re: [HACKERS] DISTINCT ON: speak now or forever hold your peace
Date: 2000-01-25 02:50:45
Message-ID: 388D0F84.FF844DF@mascari.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-sql

Tom Lane wrote:
>
> If I don't hear loud hollers very soon, I'm going to eliminate the
> DISTINCT ON "feature" for 7.0. As previously discussed, this feature
> is not standard SQL and has no clear semantic interpretation.
>

I grepped our source code and found this query:

INSERT INTO temp_sales
SELECT DISTINCT on key supplysources.supplysource,
incharges.supply, targets.target, incharges.saledate,
incharges.supplyunit, '', incharges.quantity, incharges.company,
incharges.costcntr, 'Replenish', incharges.price, '','','', 0,
text(supplysources.supplysource)||
text(incharges.supply)||
text(targets.target)||
text(incharges.saledate) as key
FROM supplysources, incharges, targets WHERE
supplysources.warehouse = incharges.warehouse AND
(targets.site,targets.area) = (incharges.site,incharges.area);

What happens is that a large charges file which is transferred to
a mainframe ERP application is first brought into PostgreSQL.
Depending upon certain race conditions, duplicate "sales" records
can appear in the data file. We use DISTINCT ON to pick (as you
point out) an arbitrary record when duplicates appear. I suppose
we could do a DELETE ... WHERE NOT EXISTS after the import. Using
DISTINCT ON just saves a step. I don't have any arguments beyond
the grounds that we're using it in existing code as a duplicate
record filter - :-(

Just FYI,

Mike Mascari

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Bruce Momjian 2000-01-25 02:51:51 Re: [HACKERS] Happy column dropping
Previous Message Chris Bitmead 2000-01-25 02:50:30 Re: [HACKERS] Happy column dropping

Browse pgsql-sql by date

  From Date Subject
Next Message Philip Warner 2000-01-25 03:03:49 Re: [HACKERS] DISTINCT ON: speak now or forever hold your peace
Previous Message Chris Bitmead 2000-01-25 02:41:25 Re: [HACKERS] DISTINCT ON: speak now or forever hold your peace