Re: fulltext parser strange behave

Tom Lane wrote:
> Andrew Dunstan <andrew(at)dunslane(dot)net> writes:
>
>> Tom Lane wrote:
>>
>>> Well, the state machine definitely thinks that tag names should contain
>>> only ASCII letters (with possibly a leading or trailing '/'). Given the
>>> HTML examples I suppose we should allow non-first digits too. Is there
>>> anything else that should be considered a tag? What about dash and
>>> underscore for instance?
>>>
>
>
>> The docs say we specifically accept HTML tags. Are we really just
>> accepting anything that is a string of ASCII letters as the tag name?
>> Then we should adjust the docs. <foo> and <foo1234> are not HTML tags.
>>
>
> I don't think I want to try to maintain a list of exactly which
> identifiers are considered valid tag names ... and if I did, I wouldn't
> put it into the parser. It would be a dictionary's job to tell valid
> from invalid tag names, no?
>
>
>

I don't have a quarrel with that. But then we should be more clear about
what we are recognizing. We could describe the thing as an HTML-like
tag, possibly. I think the same probably goes for entities too.

cheers

andrew