Re: BUG #1347: Bulk Import stopps after a while ( 8.0.0.

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Kris Jurka <books(at)ejurka(dot)com>
Cc: Bahadur Singh <bahadursingh(at)yahoo(dot)com>, pgsql-bugs(at)postgresql(dot)org, pgsql-jdbc(at)postgresql(dot)org
Subject: Re: BUG #1347: Bulk Import stopps after a while ( 8.0.0.
Date: 2004-12-13 17:21:03
Message-ID: 25966.1102958463@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs pgsql-jdbc

Kris Jurka <books(at)ejurka(dot)com> writes:
> // To avoid this, we guess at how many queries we can send before the
> // server -> driver stream's buffer is full (MAX_BUFFERED_QUERIES).

It seems essentially impossible for the driver to do this reliably,
since it has no clue how much data any one query will return.

How about instead thinking in terms of not filling the driver->server
channel? You have a good handle on how much data you have sent (or at
least you could keep track of that), and if you bound it to 64K or so
then you should be safe. Perhaps the limit ought to be easily
configurable just in case, but at least you'd be measuring something
measurable.

regards, tom lane

In response to

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message Bruce Momjian 2004-12-13 18:00:25 Re: Win 32 'could not attach to proper memory at fixed address'
Previous Message Bruce Momjian 2004-12-13 17:10:09 Re: postgresql-8.0.0 beta5 & postgresql-7.4.6 can't compile successfully

Browse pgsql-jdbc by date

  From Date Subject
Next Message Xavier Poinsard 2004-12-13 18:24:32 Updated french translation for JDBC driver
Previous Message Kris Jurka 2004-12-13 15:04:24 Re: Bug in b01