Thanks for the suggestion -- I'll try the iconv search and see.
What's odd is that I have *for sure* fixed the offending entries in the source table, but when I do a pg_dump they're back like the proverbial bad penny in the dump file.
Certainly a reason for migrating, regardless of how painful it is/
From: Tom Lane [mailto:tgl(at)sss(dot)pgh(dot)pa(dot)us]
Sent: Thu 2/16/2006 10:19 PM
To: Gregory S. Williamson
Subject: Re: [ADMIN] Something like pg_dump for 7.4
"Gregory S. Williamson" <gsw(at)globexplorer(dot)com> writes:
> I am trying to migrate a modest sized database (the unload file is just under a gigabyte) which is moderately complex, using schemas and the like from 7.4 to 8.1
> Alas, pg_dump appears to incompatable with my needs as it keeps introducing invalid UTF-8 characters.
It's quite unlikely that pg_dump is at fault. Rather the data you are
dumping is probably wrong. There were some errors in pre-8.1 versions
that caused them to accept byte sequences that are not actually legal
UTF8 strings. 8.1 has tightened up that code and so will reject data
that 7.4 thought was legal.
Check the archives for some previous discussions about reasonable ways
to fix bad data --- I seem to recall iconv being mentioned as one
possible filter for your dump file.
> Is there any way to do this ? I can't edit the resulting dump file by hand -- it's huge. And pg_dump on 7.4 does not know how to a table inside a schema -- it seems to be all or nothing.
You could use the 8.1 pg_dump against the 7.4 server if you need more
regards, tom lane
pgsql-admin by date
|Next:||From: Andy Shellam||Date: 2006-02-17 09:42:32|
|Subject: WAL archive stopping too early|
|Previous:||From: Artur Pietruk||Date: 2006-02-17 07:48:50|
|Subject: Re: Something like pg_dump for 7.4|