Re: [PROTOCOL TODO] Permit streaming of unknown-length lob/clob (bytea,text,etc)

From: David Fetter <david(at)fetter(dot)org>
To: Craig Ringer <craig(at)2ndquadrant(dot)com>
Cc: PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: [PROTOCOL TODO] Permit streaming of unknown-length lob/clob (bytea,text,etc)
Date: 2014-12-01 14:38:11
Message-ID: 20141201143811.GA7121@fetter.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Mon, Dec 01, 2014 at 02:55:22PM +0800, Craig Ringer wrote:
> Hi all
>
> Currently the client must know the size of a large lob/clob field, like
> a 'bytea' or 'text' field, in order to send it to the server. This can
> force the client to buffer all the data before sending it to the server.

Yes, this is not good.

> It would be helpful if the v4 protocol permitted the client to specify
> the field length as unknown / TBD, then stream data until an end marker
> is read.

What's wrong with specifying its length in advance instead? Are you
thinking of a one or more use cases where it's both large and unknown?

Cheers,
David.
--
David Fetter <david(at)fetter(dot)org> http://fetter.org/
Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter
Skype: davidfetter XMPP: david(dot)fetter(at)gmail(dot)com

Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Craig Ringer 2014-12-01 14:54:08 Re: [PROTOCOL TODO] Permit streaming of unknown-length lob/clob (bytea,text,etc)
Previous Message Sawada Masahiko 2014-12-01 14:29:09 Re: Proposal : REINDEX SCHEMA