Re: COPY performance

From: "Nigel J(dot) Andrews" <nandrews(at)investsystems(dot)co(dot)uk>
To: pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Re: COPY performance
Date: 2002-04-13 18:19:21
Message-ID: Pine.LNX.4.21.0204131916080.3278-100000@ponder.fairway2k.co.uk
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin pgsql-general


On Sat, 13 Apr 2002, Nigel J. Andrews wrote:
>
>
> I'm trying to COPY in a table of 1 million rows. The table is created by:
>
> [sniped]
>
> mmap()ed, STDIN can be special cased surely, and how about all the CPU power
> required for the ascii to internal representations being so high in a process
> that I would have thought to be very nearly IO bound?
>
> I could take a look at the code, not something I've done yet I must admit, and
> see if I can contribute by doing the mmap business if it's seen as a good idea.

I forgot to mention that even with 99% of the CPU it still takes a pretty long
time to load 300,000 rows, it's still working on the second batch and I think I
kicked the first off 30-60 minutes ago.

Also:

=>select version();
version
----------------------------------------------------------------------
PostgreSQL 7.2.1 on i386-unknown-freebsd3.3, compiled by GCC 2.7.2.3

--
Nigel J. Andrews
Director

---
Logictree Systems Limited
Computer Consultants

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Joe Conway 2002-04-13 18:38:40 Re: COPY performance
Previous Message Nigel J. Andrews 2002-04-13 18:13:06 COPY performance

Browse pgsql-general by date

  From Date Subject
Next Message Joe Conway 2002-04-13 18:38:40 Re: COPY performance
Previous Message Nigel J. Andrews 2002-04-13 18:13:06 COPY performance