Re: problem converting database to UTF-8

From: "Daniel Verite" <daniel(at)manitou-mail(dot)org>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: problem converting database to UTF-8
Date: 2009-01-22 22:04:58
Message-ID: af4ba1de-fb60-4ef1-9a80-2eae105200a8@mm
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Alan Hodgson wrote:

> Yeah it does. iconv buffers everything in memory, as I recall.
>
> However, you can "split" the file into manageable pieces, run each
through
> iconv, and recombine afterwards.

Another way is to just use GNU recode for large files instead of iconv.
It's slower but doesn't need much memory, contrary to iconv that indeed
seems to want the entire stream in memory before proceeding.

Best regards,
--
Daniel
PostgreSQL-powered mail user agent and storage:
http://www.manitou-mail.org

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Vladimir Konrad 2009-01-22 22:18:51 Re: problem converting database to UTF-8
Previous Message Alan Hodgson 2009-01-22 21:40:03 Re: problem converting database to UTF-8