Re: Freeze avoidance of very large table.

From: Simon Riggs <simon(at)2ndQuadrant(dot)com>
To: Robert Haas <robertmhaas(at)gmail(dot)com>
Cc: Jim Nasby <Jim(dot)Nasby(at)bluetreble(dot)com>, Bruce Momjian <bruce(at)momjian(dot)us>, Sawada Masahiko <sawada(dot)mshk(at)gmail(dot)com>, Greg Stark <stark(at)mit(dot)edu>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>, Jeff Janes <jeff(dot)janes(at)gmail(dot)com>
Subject: Re: Freeze avoidance of very large table.
Date: 2015-04-23 08:19:06
Message-ID: CANP8+jL1DBEqBM-f0MjmiZdFNZwEt=nOmjYxYpvyuUGGdfRWmg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On 21 April 2015 at 22:21, Robert Haas <robertmhaas(at)gmail(dot)com> wrote:

> I'm not saying those ideas don't have problems, because they do. But
> I think they are worth further exploring. The main reason I gave up
> on that is because Heikki was working on the XID-to-LSN mapping stuff.
> That seemed like a better approach than either of the above, so as
> long as Heikki was working on that, there wasn't much reason to pursue
> more lowbrow approaches. Clearly, though, we need to do something
> about this. Freezing is a big problem for lots of users.
>
> All that having been said, I don't think adding a new fork is a good
> approach. We already have problems pretty commonly where our
> customers complain about running out of inodes. Adding another fork
> for every table would exacerbate that problem considerably.

We were talking about having an incremental backup map also. Which sounds a
lot like the freeze map.

XID-to-LSN sounded cool but was complex. If we need the map for backup
purposes, we may as well do it the simple way and hit both birds at once.

We only need a freeze/backup map for larger relations. So if we map 1000
blocks per map page, we skip having a map at all when size < 1000.

--
Simon Riggs http://www.2ndQuadrant.com/
<http://www.2ndquadrant.com/>
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Kyotaro HORIGUCHI 2015-04-23 08:31:44 Re: [BUGS] Failure to coerce unknown type to specific type
Previous Message Kyotaro HORIGUCHI 2015-04-23 08:18:08 Re: [BUGS] Failure to coerce unknown type to specific type