From:
Jeff Davis <pgsql(at)j-davis(dot)com>
To:
Robert Haas <robertmhaas(at)gmail(dot)com>
Cc:
Bruce Momjian <bruce(at)momjian(dot)us>, Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, pgsql-hackers(at)postgresql(dot)org
Subject:
Re: crash-safe visibility map, take three
Date:
2010-12-01 22:24:22
Message-ID:
1291242262.21972.35.camel@jdavis-ux.asterdata.local (view raw or flat )
Thread:
2010-11-30 04:57:25 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 07:34:04 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 15:32:15 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 15:43:47 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 15:54:50 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 16:40:10 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 16:48:08 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 16:54:43 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 16:59:20 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 17:01:56 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 15:38:02 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 15:46:44 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 15:53:25 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 16:02:05 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 16:16:33 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 16:22:03 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 16:27:04 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 16:33:18 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 16:47:40 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 16:49:34 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 16:55:44 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 17:00:29 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 17:10:49 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 17:12:35 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 17:22:02 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 17:25:18 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 17:36:07 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 17:25:41 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 17:26:08 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-11-30 16:59:47 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-01 01:35:56 from Bruce Momjian <bruce(at)momjian(dot)us>
2010-12-01 07:35:40 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-12-01 13:39:07 from Bruce Momjian <bruce(at)momjian(dot)us>
2010-12-01 13:53:12 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-12-01 14:57:51 from "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
2010-12-01 15:46:21 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-01 15:36:51 from Bruce Momjian <bruce(at)momjian(dot)us>
2010-12-01 16:25:36 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-01 16:40:39 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-12-01 16:43:39 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-12-01 17:23:50 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-01 16:40:46 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-12-01 16:44:12 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-12-01 16:48:03 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-12-01 17:22:41 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-12-01 17:31:36 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-01 20:31:27 from Jeff Davis <pgsql(at)j-davis(dot)com>
2010-12-01 20:59:49 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-01 21:27:28 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-12-01 22:24:22 from Jeff Davis <pgsql(at)j-davis(dot)com>
2010-12-02 04:22:12 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-02 11:37:57 from Dimitri Fontaine <dimitri(at)2ndQuadrant(dot)fr>
2010-12-02 14:37:37 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-02 19:01:43 from Jeff Davis <pgsql(at)j-davis(dot)com>
2010-12-02 19:16:09 from "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
2010-12-02 22:00:18 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-02 23:37:05 from Jeff Davis <pgsql(at)j-davis(dot)com>
2010-12-03 00:06:29 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-03 00:40:44 from Jeff Davis <pgsql(at)j-davis(dot)com>
2010-12-01 23:41:33 from Jim Nasby <jim(at)nasby(dot)net>
2010-12-02 04:36:42 from Robert Haas <robertmhaas(at)gmail(dot)com>
2010-12-03 14:25:20 from Florian Weimer <fweimer(at)bfk(dot)de>
2010-11-30 16:27:30 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 16:10:13 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 16:30:53 from Heikki Linnakangas <heikki(dot)linnakangas(at)enterprisedb(dot)com>
2010-11-30 16:37:13 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2010-11-30 13:18:12 from Rob Wultsch <wultsch(at)gmail(dot)com>
2011-01-05 20:22:54 from Jesper Krogh <jesper(at)krogh(dot)cc>
2011-01-06 02:10:15 from Robert Haas <robertmhaas(at)gmail(dot)com>
2011-01-06 07:00:29 from Jesper Krogh <jesper(at)krogh(dot)cc>
2011-01-07 18:28:54 from Jim Nasby <jim(at)nasby(dot)net>
2011-01-08 02:59:36 from Robert Haas <robertmhaas(at)gmail(dot)com>
Lists:
pgsql-hackers
On Wed, 2010-12-01 at 15:59 -0500, Robert Haas wrote:
> As for CRCs, there's a pretty direct chain of inference here:
>
> 1. CRCs are hard (really impossible) because we have hint bits.
I would disagree with "impossible". If we don't set hint bits during
reading; and when we do set them, we log them (including full page
writes); then we can do CRCs.
Those things have costs, but we might be willing to pay them if we had a
bulk loading strategy that avoids or mitigates the costs.
The reason we can't do CRCs now is because hint bits violate the
WAL-before-data rule; not because of hint bits themselves. We're talking
about adding another feature that breaks the rule, in a more complex way
than hint bits.
I just wanted to step back for a second and consider the problem from a
different angle before we committed to that.
Regards,
Jeff Davis
In response to
Responses
pgsql-hackers by date
Next :From: Greg SmithDate: 2010-12-01 22:48:05Subject : Re: We really ought to do something about O_DIRECT and
data=journalled on ext4Previous :From : Dimitri FontaineDate : 2010-12-01 22:00:48Subject : Re: pg_execute_from_file review
