BUG #7794: pg_dump: errors when using pipes/streams

From: s(dot)reiser(at)tu-bs(dot)de
To: pgsql-bugs(at)postgresql(dot)org
Subject: BUG #7794: pg_dump: errors when using pipes/streams
Date: 2013-01-06 20:09:34
Message-ID: E1TrwXG-0005p0-Vb@wrigleys.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

The following bug has been logged on the website:

Bug reference: 7794
Logged by: Stefan Reiser
Email address: s(dot)reiser(at)tu-bs(dot)de
PostgreSQL version: 9.1.7
Operating system: Windows 7 Pro 64-Bit
Description:

I intend to stream the output of pg_dump into a zip file (along with some
other files and comments).

pg_dump shows one or more warnings when used with non-seekable streams:
"pg_dump: [custom archiver] WARNING: ftell mismatch with expected position
-- ftell used"

Examples (on Windows 7 Pro 64 Bit, PG 9.1.7 and 9.1.6, 64 Bit)

1) pg_dump --format=custom --schema-only mydatabase | zip -0 TEST.ZIP -
2) pg_dump --format=custom --schema-only mydatabase > NUL
3) pg_dump --format=custom --schema-only --file TEST3 mydatabase
4) pg_dump --format=custom --schema-only mydatabase > TEST4

1 and 2 print warnings, while pg_dump's exit code is 0 (as can be verified
with example 2),
3 and 4 are ok.

I've used "--schema-only" to emphasize that it's not a question of file size
(without "--schema-only" the number of warnings increases, supposedly one
per table).
The "zip" in example 1 is Info-ZIP 3.0 - but you can as well use anything
that consumes STDIN, like gzip, ...)

Files TEST3 and TEST4 are of the same size, the file packaged in TEST.ZIP is
slightly bigger.
With all three generated files pg_restore produces exactly the same script,
so the backup seems ok - but why the warnings then? (And what do they mean,
anyway?) Are those backups reliable or could they as well become corrupted?
(after all, it seems pg_dump wants to write something somewhere for some
reason, but can't...)

A similar problem has been reported as "BUG #6726"
(http://archives.postgresql.org/pgsql-bugs/2012-07/msg00074.php) but I
couldn't find any replies ... so I filed this new report.
(Formats tar and plain don't seem to produce these warnings, so I'll work
around the problem by using the tar format.)

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message paul.watson 2013-01-06 23:22:39 BUG #7795: Cannot choose UTF-8 encoding for initdb
Previous Message davios 2013-01-06 16:23:55 BUG #7793: tsearch_data thesaurus size limit