Re: horizontal sharding

From: mobiledreamers(at)gmail(dot)com
To: Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>
Cc: John R Pierce <pierce(at)hogranch(dot)com>, David Fetter <david(at)fetter(dot)org>, pgsql-general(at)postgresql(dot)org
Subject: Re: horizontal sharding
Date: 2009-06-27 07:53:51
Message-ID: c1870d60906270053m45c9d8e8u7bccba52818652c7@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

yeah i have never tried slony
and i didnt try plproxy as it is a new language and need to modify all
client code

not modifiying client code in pgpool 2 rocks

On Sat, Jun 27, 2009 at 12:52 AM, Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com>wrote:

> Oh crap I think I mixed it up in my head with slony II. nevermind. :)
>
> On Sat, Jun 27, 2009 at 1:17 AM, <mobiledreamers(at)gmail(dot)com> wrote:
> > no it is very good and well designed the whole app code doesnt need to
> > change
> >
> > we jus need to configure the pgpool insertion logic
> >
> > and it has a cool pgpooladmin in php like phppgadmin
> >
> > if only i can get it to work
> >
> > On Fri, Jun 26, 2009 at 10:53 PM, Scott Marlowe <scott(dot)marlowe(at)gmail(dot)com
> >
> > wrote:
> >>
> >> I thought pgool II was abandonware...
> >>
> >> On Fri, Jun 26, 2009 at 7:50 PM, <mobiledreamers(at)gmail(dot)com> wrote:
> >> > Hey john
> >> > thanks
> >> > i did read both extensively, but finishing all the steps parallel mode
> >> > or
> >> > horizontal partitioning mode doesnot work!
> >> > but this is my conf file
> >> >
> >> > # backend_hostname, backend_port, backend_weight
> >> > # here are examples
> >> > backend_hostname0 = 'localhost'
> >> > backend_port0 = 5432
> >> > backend_weight0 = 1
> >> > backend_data_directory0 = '/mnt/work/database'
> >> > backend_hostname1 = 'marc.somehost.com'
> >> > backend_port1 = 5432
> >> > backend_weight1 = 1
> >> > backend_data_directory1 = '/mnt/work/database'
> >> > this is the problem
> >> > pgpool-II-2.2.2]$ createdb -p 9999
> >> > createdb: could not connect to database postgres: server closed the
> >> > connection unexpectedly
> >> > This probably means the server terminated abnormally
> >> > before or while processing the request.
> >> >
> >> >
> ------------------------------------------------------------------------------------------------------------------------------------
> >> > Error in log
> >> > tail -f /tmp/pgpool.log
> >> > 2009-06-26 17:24:07 LOG: pid 5561: pgpool successfully started
> >> > 2009-06-26 18:48:34 ERROR: pid 5563: pool_read_int: data does not
> match
> >> > between between master(0) slot[1] (50331648)
> >> > 2009-06-26 18:48:34 ERROR: pid 5563: pool_do_auth: read auth kind
> failed
> >> > tail -f /tmp/pgpool.log
> >> > 2009-06-26 18:49:37 DEBUG: pid 23506: s_do_auth: backend key data
> >> > received
> >> > 2009-06-26 18:49:37 DEBUG: pid 23506: s_do_auth: transaction state: I
> >> > 2009-06-26 18:49:40 DEBUG: pid 23466: I am 23466 accept fd 7
> >> > 2009-06-26 18:49:40 DEBUG: pid 23466: Protocol Major: 3 Minor: 0
> >> > database:
> >> > postgres user: mark
> >> > 2009-06-26 18:49:40 DEBUG: pid 23466: new_connection: connecting 0
> >> > backend
> >> > 2009-06-26 18:49:40 DEBUG: pid 23466: new_connection: connecting 1
> >> > backend
> >> > 2009-06-26 18:49:40 DEBUG: pid 23466: pool_read_message_length: slot:
> 0
> >> > length: 8
> >> > 2009-06-26 18:49:40 DEBUG: pid 23466: pool_read_message_length: slot:
> 1
> >> > length: 8
> >> > 2009-06-26 18:49:40 ERROR: pid 23466: pool_read_int: data does not
> match
> >> > between between master(0) slot[1] (50331648)
> >> > 2009-06-26 18:49:40 ERROR: pid 23466: pool_do_auth: read auth kind
> >> > failed
> >> >
> >> > On Fri, Jun 26, 2009 at 5:56 PM, John R Pierce <pierce(at)hogranch(dot)com>
> >> > wrote:
> >> >>
> >> >> mobiledreamers(at)gmail(dot)com wrote:
> >> >>>
> >> >>> can someone show how to setup pgpool 2 in parallel *query* mode ie
> >> >>> horizontal partitioning
> >> >>
> >> >> did you look at
> >> >>
> >> >>
> http://pgpool.projects.postgresql.org/pgpool-II/doc/tutorial-en.html#parallel
> >> >> ?
> >> >>
> >> >> I'd pay close attention to the restrictions here, too...
> >> >>
> >> >>
> http://pgpool.projects.postgresql.org/pgpool-II/doc/pgpool-en.html#restriction
> >> >>
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> > Bidegg worlds best auction site
> >> > http://bidegg.com
> >> >
> >>
> >>
> >>
> >> --
> >> When fascism comes to America, it will be intolerance sold as diversity.
> >
> >
> >
> > --
> > Bidegg worlds best auction site
> > http://bidegg.com
> >
>
>
>
> --
> When fascism comes to America, it will be intolerance sold as diversity.
>

--
Bidegg worlds best auction site
http://bidegg.com

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Alban Hertroys 2009-06-27 09:40:55 Re: Need suggestions
Previous Message Scott Marlowe 2009-06-27 07:52:00 Re: horizontal sharding