Re: PostgreSQL and big data - FDW

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Bruce Momjian <bruce(at)momjian(dot)us>
Cc: ROS Didier <didier(dot)ros(at)edf(dot)fr>, "pgsql-hackers(at)lists(dot)postgresql(dot)org" <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: Re: PostgreSQL and big data - FDW
Date: 2020-06-24 16:53:28
Message-ID: 20200624165328.GS3125@tamriel.snowman.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Greetings,

* Bruce Momjian (bruce(at)momjian(dot)us) wrote:
> On Wed, Jun 24, 2020 at 09:05:30AM +0000, ROS Didier wrote:
> > I would like to use a Foreign Data Wrapper (FDW) to connect to a HADOOP cluster
> > which uses KERBEROS authentication.

Sadly, not really.

> > is it possible to achieve this ? which FDW should be used ?
>
> Well, I would use the Hadoop FDW:
>
> https://github.com/EnterpriseDB/hdfs_fdw
>
> and it only supports these authentication methods:
>
> Authentication Support
>
> The FDW supports NOSASL and LDAP authentication modes. In order to use
> NOSASL do not specify any OPTIONS while creating user mapping. For LDAP
> username and password must be specified in OPTIONS while creating user mapping.
>
> Not every FDW supports every Postgres server authentication method.

That isn't really the issue here, the problem is really that the GSSAPI
support in PG today doesn't support credential delegation- if it did,
then the HDFS FDW (and the postgres FDW) could be easily extended to
leverage those delegated credentials to connect.

That's been something that's been on my personal todo list of things to
work on but unfortunately I've not, as yet, had time to go implement. I
don't actually think it would be very hard- if someone writes it, I'd
definitely review it.

Thanks,

Stephen

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2020-06-24 16:55:22 Re: [PATCH] COPY command's data format option allows only lowercase csv, text or binary
Previous Message Stephen Frost 2020-06-24 16:50:16 Re: SIGSEGV from START_REPLICATION 0/XXXXXXX in XLogSendPhysical () at walsender.c:2762