RE: PostgreSQL and big data - FDW

Hi Stephen

My EDF company is very interested in this feature (KERBEROS authentication method and hdfs_fdw ).
Is it possible to know how many days of development does this represent ? who can develop this implementation ? what cost ?

Best Regards
Didier ROS
EDF
-----Message d'origine-----
De : sfrost(at)snowman(dot)net [mailto:sfrost(at)snowman(dot)net]
Envoyé : mercredi 24 juin 2020 18:53
À : Bruce Momjian <bruce(at)momjian(dot)us>
Cc : ROS Didier <didier(dot)ros(at)edf(dot)fr>; pgsql-hackers(at)lists(dot)postgresql(dot)org
Objet : Re: PostgreSQL and big data - FDW

Greetings,

* Bruce Momjian (bruce(at)momjian(dot)us) wrote:
> On Wed, Jun 24, 2020 at 09:05:30AM +0000, ROS Didier wrote:
> > I would like to use a Foreign Data Wrapper (FDW) to connect to a
> > HADOOP cluster which uses KERBEROS authentication.

Sadly, not really.

> > is it possible to achieve this ? which FDW should be used ?
>
> Well, I would use the Hadoop FDW:
>
> https://github.com/EnterpriseDB/hdfs_fdw
>
> and it only supports these authentication methods:
>
> Authentication Support
>
> The FDW supports NOSASL and LDAP authentication modes. In order to use
> NOSASL do not specify any OPTIONS while creating user mapping. For LDAP
> username and password must be specified in OPTIONS while creating user mapping.
>
> Not every FDW supports every Postgres server authentication method.

That isn't really the issue here, the problem is really that the GSSAPI support in PG today doesn't support credential delegation- if it did, then the HDFS FDW (and the postgres FDW) could be easily extended to leverage those delegated credentials to connect.

That's been something that's been on my personal todo list of things to work on but unfortunately I've not, as yet, had time to go implement. I don't actually think it would be very hard- if someone writes it, I'd definitely review it.

Thanks,

Stephen

Ce message et toutes les pièces jointes (ci-après le 'Message') sont établis à l'intention exclusive des destinataires et les informations qui y figurent sont strictement confidentielles. Toute utilisation de ce Message non conforme à sa destination, toute diffusion ou toute publication totale ou partielle, est interdite sauf autorisation expresse.

Si vous n'êtes pas le destinataire de ce Message, il vous est interdit de le copier, de le faire suivre, de le divulguer ou d'en utiliser tout ou partie. Si vous avez reçu ce Message par erreur, merci de le supprimer de votre système, ainsi que toutes ses copies, et de n'en garder aucune trace sur quelque support que ce soit. Nous vous remercions également d'en avertir immédiatement l'expéditeur par retour du message.

Il est impossible de garantir que les communications par messagerie électronique arrivent en temps utile, sont sécurisées ou dénuées de toute erreur ou virus.
____________________________________________________

This message and any attachments (the 'Message') are intended solely for the addressees. The information contained in this Message is confidential. Any use of information contained in this Message not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval.

If you are not the addressee, you may not copy, forward, disclose or use any part of it. If you have received this message in error, please delete it and all copies from your system and notify the sender immediately by return message.

E-mail communication cannot be guaranteed to be timely secure, error or virus-free.