Re: Horizontal scalability/sharding

On Mon, Aug 31, 2015 at 09:53:57AM +0900, Michael Paquier wrote:
> Well, I have had many such discussions with XC/XL folks, and that was my
> opinion.  I have seen almost no public discussion about this because the
> idea had almost no chance of success.  If it was possible, someone would
> have already suggested it on this list.
>
>
> Or perhaps people invested in this area had other obligations or lacked
> motivation and/or time to work to push up for things in core. That's not
> possible to know, and what is done is done.

Well, I have talked to everyone privately about this, and concluded that
while horizontal scalability/sharding is useful, it is unlikely that the
code volume of something like XC or XL would be accepted into the
community, and frankly, now that we have FDWs, it is hard to imagine why
we would _not_ go in the FDW direction.

Of course, people have concerns, and FDWs might need to be improved, but
it is something worth researching. We might find out FDWs can't be used
at all, and that we have to either add much more code to Postgres to do
sharding, do something like pg_shard, or not implement built-in sharding
at all, but at least it is time to research this.

> OK, I will send you a separate email and you can then supply their email
> addresses.
>
>
> FWIW, I would be interested in that as well. I worked in this area of things
> for a couple of years as well FWIW.

OK, I will send you an email.

--
Bruce Momjian <bruce(at)momjian(dot)us> http://momjian.us
EnterpriseDB http://enterprisedb.com

+ Everyone has their own god. +