Re: Parser extensions (maybe for 10?)

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Arcadiy Ivanov <arcadiy(at)gmail(dot)com>
Cc: pgsql-hackers(at)postgresql(dot)org
Subject: Re: Parser extensions (maybe for 10?)
Date: 2016-04-12 05:10:31
Message-ID: 5688.1460437831@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Arcadiy Ivanov <arcadiy(at)gmail(dot)com> writes:
> Is there any interest and/or tips to allow a pluggable parser or at
> least allow some syntactical pluggability by extensions?

There is a fair amount of discussion of this in the archives. The short
answer is that bison can't do it, and "let's replace bison" is a proposal
with a steep hill in front of it --- the pain-to-gain ratio is just not
very favorable.

Forty years ago, I worked on systems with extensible parsers at HP,
wherein plug-in extensions could add clauses very similarly to what
you suggest. Those designs worked, more or less, but they had a lot
of deficiencies; the most fundamental problem being that any parsing
inconsistencies would only appear through misbehavior at runtime,
which you would only discover if you happened to test a case that behaved
oddly *and* notice that it was not giving the result you expected.
Bison is far from perfect on this angle, because %prec declarations can
produce results you weren't expecting ... but it's at least one order of
magnitude better than any extensible-parser solution I've ever seen.
Usually bison will give you a shift/reduce error if you write something
that has more than one possible interpretation.

I'm interested in possible solutions to this problem, but it's far
harder than it looks.

regards, tom lane

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Craig Ringer 2016-04-12 05:22:11 Re: Parser extensions (maybe for 10?)
Previous Message Andres Freund 2016-04-12 05:00:38 Re: [COMMITTERS] pgsql: Allow Pin/UnpinBuffer to operate in a lockfree manner.