Re: Encoding errors when upgrading from 7.4 to 8.1

On Thu, Jan 26, 2006 at 06:07:45PM +0000, Adam Witney wrote:
> Hi,
>
> I am upgrading from 7.4.8 -> 8.1.2 on Linux 2.6.14.3 #1 SMP
>
> I have installed 8.1.2 and created the database (with encoding 'UNICODE', as
> I had done in 7.4.8) and am trying to load a 7.4.8 dump file but I am
> getting a few errors like this:
>
> psql:bugasbase2-backup:45880: ERROR: invalid UTF-8 byte sequence detected
> near byte 0xb5
> CONTEXT: COPY array_scheme, line 17560, column gene_identifier: "B?G(at)S
> (0G11)"

There were some changes in the checking. PostgreSQL used to allow
invalid utf-8 sequences in that it no longer accepts. You basically
need to clean up the data. Something like what's suggested here:

http://archives.postgresql.org/pgsql-hackers/2005-12/msg00511.php

may be helpful. This whole thread is useful actually...
--
Martijn van Oosterhout <kleptog(at)svana(dot)org> http://svana.org/kleptog/
> Patent. n. Genius is 5% inspiration and 95% perspiration. A patent is a
> tool for doing 5% of the work and then sitting around waiting for someone
> else to do the other 95% so you can sue them.