Re: [NOVICE] systable_getnext_ordered

From: yamt(at)mwd(dot)biglobe(dot)ne(dot)jp (YAMAMOTO Takashi)
To: tgl(at)sss(dot)pgh(dot)pa(dot)us
Cc: pgsql-novice(at)postgresql(dot)org, pgsql-hackers(at)postgresql(dot)org
Subject: Re: [NOVICE] systable_getnext_ordered
Date: 2011-01-31 23:39:24
Message-ID: 20110131233924.4CA8819CF94@mail.netbsd.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-novice

hi,

> I wrote:
>> yamt(at)mwd(dot)biglobe(dot)ne(dot)jp (YAMAMOTO Takashi) writes:
>>> after systable_getnext_ordered returned NULL, is it ok to call it again?
>
>> I wouldn't rely on it working.
>
>>> i'm wondering because inv_truncate seems to do it and expecting NULL.
>
>> Hmm, that may well be a bug. Have you tested it?
>
> I looked at this a bit more closely, and basically the answer is that
> inv_truncate is accidentally failing to fail. What will actually happen
> if systable_getnext_ordered is called another time, at least when using
> a btree index, is that it will start the same requested scan over again,
> ie deliver all the tuples it did the first time (which is none, in this
> case). That's an implementation artifact, but since the behavior is
> undefined in the first place, it's not wrong.
>
> Now, if inv_truncate's initial call on systable_getnext_ordered returns
> NULL (ie, the truncation point is past the current EOF page), it will
> fall through to the "Write a brand new page" code, which will create and
> insert a partial page at the truncation point. It then goes to the
> delete-all-remaining-pages loop. Because that starts a fresh scan with
> the very same scan key conditions, you might expect that it would find
> and delete the page it just inserted --- causing the apparent EOF of the
> blob to be wrong afterwards. It accidentally fails to do that because
> the new tuple postdates the snapshot it's scanning with. So the loop
> terminates having found no matching tuples, and all is well.
>
> So this code is confusing, inefficient (performing a useless search of
> the index), only works because of an obscure consideration not explained
> in the comments, and sets a bad precedent for people to follow. I'm
> going to go change it to explicitly not do the final loop if the initial
> search failed. It's not a bug, exactly, but it's sure lousy coding.
> Thanks for pointing it out.

thanks for the quick investigation and fix.

the attached patch is to avoid unnecessary detoast'ing and EOF marker pages
when possible. does it make sense?

YAMAMOTO Takashi

>
> regards, tom lane
>
> --
> Sent via pgsql-hackers mailing list (pgsql-hackers(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-hackers

Attachment Content-Type Size
lo.diff text/plain 7.6 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Kevin Grittner 2011-01-31 23:55:04 Re: SSI patch version 14
Previous Message Robert Haas 2011-01-31 23:21:06 Re: Error code for "terminating connection due to conflict with recovery"

Browse pgsql-novice by date

  From Date Subject
Next Message Tom Lane 2011-02-01 00:02:26 Re: [HACKERS] systable_getnext_ordered
Previous Message Leon Starr 2011-01-31 21:51:52 Re: How to 'print a table' in the middle of a plpgsql function