Re: Make COPY format extendable: Extract COPY TO format implementations

From: "Daniel Verite" <daniel(at)manitou-mail(dot)org>
To: "Sutou Kouhei" <kou(at)clear-code(dot)com>
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: Re: Make COPY format extendable: Extract COPY TO format implementations
Date: 2023-12-06 12:31:59
Message-ID: ee94f987-f4ca-4a0c-96d7-909465d20808@manitou-mail.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Sutou Kouhei wrote:

> * 2022-04: Apache Arrow [2]
> * 2018-02: Apache Avro, Apache Parquet and Apache ORC [3]
>
> (FYI: I want to add support for Apache Arrow.)
>
> There were discussions how to add support for more formats. [3][4]
> In these discussions, we got a consensus about making COPY
> format extendable.

These formats seem all column-oriented whereas COPY is row-oriented
at the protocol level [1].
With regard to the procotol, how would it work to support these formats?

[1] https://www.postgresql.org/docs/current/protocol-flow.html#PROTOCOL-COPY

Best regards,
--
Daniel Vérité
https://postgresql.verite.pro/
Twitter: @DanielVerite

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Andrew Dunstan 2023-12-06 12:36:36 Re: Emitting JSON to file using COPY TO
Previous Message Peter Eisentraut 2023-12-06 11:27:17 Re: Is WAL_DEBUG related code still relevant today?