Re: Slow BLOBs restoring

From: Vlad Arkhipov <arhipov(at)dc(dot)baikal(dot)ru>
To: pgsql-performance(at)postgresql(dot)org
Subject: Re: Slow BLOBs restoring
Date: 2010-12-08 08:50:05
Message-ID: 4CFF46BD.8070004@dc.baikal.ru
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

I discovered this issue a bit more. -j option is slowing down BLOBs
restoring. It's about 1000x times slower if you specify this option.
Does anybody plan to fix it?
> I have encountered a problem while restoring the database. There is a
> table that contains XML data (BLOB), ~ 3 000 000 records, ~ 5.5Gb of
> data. pg_restore has been running for a week without any considerable
> progress. There are plenty of lines like these in the log:
>
> pg_restore: processing item 3125397 BLOB 10001967
> pg_restore: executing BLOB 10001967
>
> CPU usage is 100% always. The total database size is about 100 Gb and
> it restores in an hour or so without BLOBs.
>

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Dmitriy Igrishin 2010-12-08 08:51:05 Re: Feature request - CREATE TYPE ... WITH OID = oid_number.
Previous Message David Fetter 2010-12-08 08:19:49 Re: wCTE behaviour

Browse pgsql-performance by date

  From Date Subject
Next Message Tom Lane 2010-12-08 14:34:23 Re: Performance under contention
Previous Message Robert Haas 2010-12-08 04:24:14 Re: Performance under contention