Re: parallel dump fails to dump large tables

From: Shanker Singh <ssingh(at)iii(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, "rod(at)iol(dot)ie" <rod(at)iol(dot)ie>
Cc: "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: Re: parallel dump fails to dump large tables
Date: 2015-02-20 22:26:27
Message-ID: 961471F4049EF94EAD4D0165318BD8816259064A@Corp-MBXE3.iii.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

I tried turning off ssl renegotiation by setting "ssl_renegotiation_limit = 0" in postgresql.conf but it had no effect. The parallel dump still fails on large tables consistently.

Thanks
Shanker

-----Original Message-----
From: Tom Lane [mailto:tgl(at)sss(dot)pgh(dot)pa(dot)us]
Sent: Saturday, February 14, 2015 9:00 AM
To: rod(at)iol(dot)ie
Cc: Shanker Singh; pgsql-general(at)postgresql(dot)org
Subject: Re: [GENERAL] parallel dump fails to dump large tables

"Raymond O'Donnell" <rod(at)iol(dot)ie> writes:
> On 14/02/2015 15:42, Shanker Singh wrote:
>> Hi,
>> I am having problem using parallel pg_dump feature in postgres
>> release 9.4. The size of the table is large(54GB). The dump fails
>> with the
>> error: "pg_dump: [parallel archiver] a worker process died
>> unexpectedly". After this error the pg_dump aborts. The error log
>> file gets the following message:
>>
>> 2015-02-09 15:22:04 PST [8636]: [2-1]
>> user=pdroot,db=iii,appname=pg_dump
>> STATEMENT: COPY iiirecord.varfield (id, field_type_tag, marc_tag,
>> marc_ind1, marc_ind2, field_content, field_group_id, occ_num,
>> record_id) TO stdout;
>> 2015-02-09 15:22:04 PST [8636]: [3-1]
>> user=pdroot,db=iii,appname=pg_dump
>> FATAL: connection to client lost

> There's your problem - something went wrong with the network.

I'm wondering about SSL renegotiation failures as a possible cause of the disconnect --- that would explain why it only happens on large tables.

regards, tom lane

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message sridhar bamandlapally 2015-02-21 02:30:31 Re: Array string casts with SELECT but not SELECT DISTINCT
Previous Message Thomas Kellerer 2015-02-20 22:06:07 Re: How to convert "output deleted/inserted into" in MySQL to Postgres