Re: Re: COPY table_name (single_column) FROM 'unknown.txt' DELIMITER E'\n'

From: Justin Pryzby <pryzby(at)telsasoft(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Joel Jacobson <joel(at)compiler(dot)org>, "David G(dot) Johnston" <david(dot)g(dot)johnston(at)gmail(dot)com>, Isaac Morland <isaac(dot)morland(at)gmail(dot)com>, Chapman Flack <chap(at)anastigmatix(dot)net>, pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: Re: COPY table_name (single_column) FROM 'unknown.txt' DELIMITER E'\n'
Date: 2021-05-05 19:36:01
Message-ID: 20210505193600.GX27406@telsasoft.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, May 05, 2021 at 02:45:41PM -0400, Tom Lane wrote:
> > I'm currently using the pg_read_file()-hack in a project,
> > and even though it can read files up to 1GB,
> > using e.g. regexp_split_to_table() to split on E'\n'
> > seems to need 4x as much memory, so it only
> > works with files less than ~256MB.
>
> Yeah, that's because of the conversion to "chr". But a regexp
> is overkill for that anyway. Don't we have something that will
> split on simple substring matches?

For v14

commit 66f163068030b5c5fe792a0daee27822dac43791
Author: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Date: Wed Sep 2 18:23:56 2020 -0400

Add string_to_table() function.

--
Justin

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Matthias van de Meent 2021-05-05 19:43:01 Re: MaxOffsetNumber for Table AMs
Previous Message Peter Geoghegan 2021-05-05 19:26:53 Re: MaxOffsetNumber for Table AMs