Re: Comparing two (largish) tables on different servers

From: Michael Fuhr <mike(at)fuhr(dot)org>
To: pgsql-sql(at)postgresql(dot)org
Subject: Re: Comparing two (largish) tables on different servers
Date: 2004-11-10 19:32:50
Message-ID: 20041110193250.GA18174@winnie.fuhr.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

On Wed, Nov 10, 2004 at 09:18:21AM +0000, Sam Mason wrote:
>
> mkfifo db1
> psql -h "db1" -t -q -c "$query" > db1
> mkfifo db2
> psql -h "db2" -t -q -c "$query" > db2
> diff -u -0 db1 db2

This should work for small data sets, but the OP said the tables
were about 5G. Unless you use a cursor, psql will fetch the entire
result before writing anything. Also, some implementations of diff
might read all of the data from one file before reading much from
the other file, especially if the files have differences. Hope
you have lots of memory....

--
Michael Fuhr
http://www.fuhr.org/~mfuhr/

In response to

Browse pgsql-sql by date

  From Date Subject
Next Message Stefan Weiss 2004-11-10 21:36:41 Re: A transaction in transaction? Possible?
Previous Message Goutam Paruchuri 2004-11-10 18:38:35 Re: Error In connection ??