From:
Stephen Frost <sfrost(at)snowman(dot)net>
To:
Claudio Freire <klaussfreire(at)gmail(dot)com>
Cc:
Peter Eisentraut <peter_e(at)gmx(dot)net>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>,Simon Riggs <simon(at)2ndquadrant(dot)com>,PostgreSQL-Dev <pgsql-hackers(at)postgresql(dot)org>
Subject:
Re: [PATCH] COPY .. COMPRESSED
Date:
2013-01-15 17:31:17
Message-ID:
20130115173117.GS16126@tamriel.snowman.net (view raw or flat )
Thread:
2013-01-14 02:16:44 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-14 03:34:33 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2013-01-14 13:43:11 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-14 14:23:31 from Simon Riggs <simon(at)2ndQuadrant(dot)com>
2013-01-14 16:01:06 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-14 16:06:47 from Claudio Freire <klaussfreire(at)gmail(dot)com>
2013-01-14 16:24:52 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-14 16:13:17 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2013-01-14 16:28:30 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-14 21:56:05 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2013-01-15 02:33:39 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-15 13:35:57 from Greg Stark <stark(at)mit(dot)edu>
2013-01-15 17:22:53 from Garick Hamlin <ghamlin(at)isc(dot)upenn(dot)edu>
2013-01-15 14:55:31 from Claudio Freire <klaussfreire(at)gmail(dot)com>
2013-01-15 16:08:45 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-15 17:22:56 from Claudio Freire <klaussfreire(at)gmail(dot)com>
2013-01-15 17:31:17 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-16 22:05:30 from Robert Haas <robertmhaas(at)gmail(dot)com>
2013-01-15 15:22:25 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2013-01-15 15:55:04 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-15 19:24:09 from Bruce Momjian <bruce(at)momjian(dot)us>
2013-01-15 19:53:29 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-15 20:37:07 from Christopher Browne <cbbrowne(at)gmail(dot)com>
2013-01-15 20:42:48 from Bruce Momjian <bruce(at)momjian(dot)us>
2013-01-15 21:22:48 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-15 22:22:47 from Bruce Momjian <bruce(at)momjian(dot)us>
2013-01-15 22:24:37 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-15 21:20:46 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-16 22:15:49 from Robert Haas <robertmhaas(at)gmail(dot)com>
2013-01-16 22:40:17 from Christopher Browne <cbbrowne(at)gmail(dot)com>
2013-01-15 21:50:08 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2013-01-15 22:19:58 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-15 22:46:57 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2013-01-15 23:07:01 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-15 23:17:05 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2013-01-15 23:22:59 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2013-01-15 23:33:19 from Andrew Dunstan <andrew(at)dunslane(dot)net>
2013-01-16 02:44:45 from Claudio Freire <klaussfreire(at)gmail(dot)com>
2013-01-16 23:19:09 from Robert Haas <robertmhaas(at)gmail(dot)com>
2013-01-16 23:25:49 from Bruce Momjian <bruce(at)momjian(dot)us>
2013-01-16 23:31:44 from Stephen Frost <sfrost(at)snowman(dot)net>
2013-01-17 02:48:16 from Claudio Freire <klaussfreire(at)gmail(dot)com>
2013-01-16 20:04:45 from Peter Eisentraut <peter_e(at)gmx(dot)net>
2013-01-16 20:12:08 from Stephen Frost <sfrost(at)snowman(dot)net>
Lists:
pgsql-hackers
* Claudio Freire (klaussfreire(at)gmail(dot)com) wrote:
> On Tue, Jan 15, 2013 at 1:08 PM, Stephen Frost <sfrost(at)snowman(dot)net> wrote:
> > Where it does work well is when you move into a bulk-data mode (ala
> > COPY) and can compress relatively large amounts of data into a smaller
> > number of full-size packets to be sent.
>
> Well... exactly. COPY is one case, big result sets is another.
> And packet headers can include whether each packet is compressed or
> not, which is quite transparent and easy to handle. There could even
> be a negotiation phase and make it backwards-compatible.
COPY and a large result set are the only cases, and a large result set
could easily be put inside of a COPY statement. I agree that large
result sets outside of COPY could benefit from compression and perhaps
we can formulate a way to support that also.
Thanks,
Stephen
In response to
pgsql-hackers by date
Next :From: Heikki LinnakangasDate: 2013-01-15 18:10:05Subject : Re: unlogged tables vs. GISTPrevious :From : Sergey KoposovDate : 2013-01-15 17:27:50Subject : Re: Curious buildfarm failures (fwd)
