Re: rsync and streaming replication

From: Jean-Armel Luce <jaluce06(at)gmail(dot)com>
To: Scott Ribe <scott_ribe(at)elevated-dev(dot)com>
Cc: Cédric Villemain <cedric(dot)villemain(dot)debian(at)gmail(dot)com>, "[ADMIN]" <pgsql-admin(at)postgresql(dot)org>
Subject: Re: rsync and streaming replication
Date: 2011-11-15 20:11:37
Message-ID: CALnckSoq-2PrtNvOUxv1h1_2X-G7zVuXZqHGJJoZcbT=eMPbGQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Humm sorry, I did a mistake

2011/11/15 Jean-Armel Luce <jaluce06(at)gmail(dot)com>

> Sorry to be so long to answer :-(
> - How large is the db? By which I mean how much disk space does the
> data directory occupy?
> 100 GB
>
>
>
> 2011/11/14 Scott Ribe <scott_ribe(at)elevated-dev(dot)com>
>
> - How large is the db? By which I mean how much disk space does the
> data directory occupy?
> 20 GB
>
>
> - What's the bandwidth of the network connection to the distant slave?
> during rsync, I see narly 125Mbits/sec
>
>
> - What's the CPU & disk on each end?
> disk : 6 * 146GB 15Krpm RAID10
> CPU : 16 cores Xeon(R) CPU L5630 @ 2.13GHz cache size : 12288 KB
>
> Only Postgres is running on my servers (no HTTP server, nothing else,
> ...). CPU usage is very low.
>
> This afternoon, I have again sent some updates requests, which were
> replicated to the sslaves.
> :
> - I am looking modification of modification dates and checksums of 2
> tables among my 6000 tables :
> For each file, the checksum is the same on all the slaves, but different
> from the checksum of the master.
> For each file, the modification time is different on each node. (see below)
>
> So if I want to promote one slave as the master, it will not need to copy
> data from the new master to the previous slaves with rsync, but it will
> copy all the files from the new master to the old master (which is now a
> slave).
>
> I shall try tomorrow topromote again a slave, and I shall rsync withh
> --checksum.
> I don't think that it is -a is very useful withh --checksum (no need to
> preserve modification times). Do you agree ?
>
>
>
> On the master :
> postgres(at)master-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> ls -l 107867807
> -rw------- 1 postgres postgres 5914624 Nov 15 14:31 107867807
> postgres(at)master-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> md5sum 107867807
> 23c28c6432c073d370e7e9624fd04e3b 107867807
>
> postgres(at)master-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> ls -l 107867867
> -rw------- 1 postgres postgres 5996544 Nov 15 14:31 107867867
> postgres(at)master-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> md5sum 107867867
> 1f3398e18e22bfeb31ca2db82d8517f2 107867867
> postgres(at)master-db01
> :/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
>
>
> On slave 1 :
> postgres(at)master-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> ls -l 107867807
> -rw------- 1 postgres postgres 5914624 Nov 15 14:16 107867807
> postgres(at)master-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> md5sum 107867807
> f79d93ca00ac400f709a028c597ca4ab 107867807
> postgres(at)master-db01
> :/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> postgres(at)master-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> ls -l 107867867
> -rw------- 1 postgres postgres 5996544 Nov 15 14:18 107867867
> postgres(at)master-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> md5sum 107867867
> 3d5534f855168378f5cb2e30d622c0aa 107867867
>
>
> On slave 2 :
> postgres(at)slave-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> ls -l 107867807
> -rw------- 1 postgres postgres 5914624 Nov 15 14:24 107867807
> postgres(at)slave-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> md5sum 107867807
> f79d93ca00ac400f709a028c597ca4ab 107867807
> postgres(at)slave-db01
> :/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> postgres(at)slave-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> ls -l 107867867
> -rw------- 1 postgres postgres 5996544 Nov 15 14:25 107867867
> postgres(at)slave-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> md5sum 107867867
> 3d5534f855168378f5cb2e30d622c0aa 107867867
>
>
>
> On slave 3 :
> postgres(at)slave-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> ls -l 107867807
> -rw------- 1 postgres postgres 5914624 Nov 15 14:16 107867807
> postgres(at)slave-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> md5sum 107867807
> f79d93ca00ac400f709a028c597ca4ab 107867807
> postgres(at)slave-db01
> :/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> postgres(at)slave-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> ls -l 107867867
> -rw------- 1 postgres postgres 5996544 Nov 15 14:18 107867867
> postgres(at)slave-db01:/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> md5sum 107867867
> 3d5534f855168378f5cb2e30d622c0aa 107867867
> postgres(at)slave-db01
> :/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
> postgres(at)slave-db01
> :/var/opt/hosting/db/profiles/bench/PG_9.0_201008051/29797$
>
> Jal
>
>
>
>>
>> --
>> Sent via pgsql-admin mailing list (pgsql-admin(at)postgresql(dot)org)
>> To make changes to your subscription:
>> http://www.postgresql.org/mailpref/pgsql-admin
>>
>
>
>

In response to

Browse pgsql-admin by date

  From Date Subject
Next Message Cédric Villemain 2011-11-15 20:31:38 Re: rsync and streaming replication
Previous Message Jean-Armel Luce 2011-11-15 18:39:52 Re: rsync and streaming replication