Re: [HACKERS] Online DW

From: Sridhar N Bamandlapally <sridhar(dot)bn1(at)gmail(dot)com>
To: Craig Ringer <craig(at)2ndquadrant(dot)com>
Cc: PG-General Mailing List <pgsql-general(at)postgresql(dot)org>, PostgreSQL-hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: [HACKERS] Online DW
Date: 2016-06-10 09:18:22
Message-ID: CAGuFTBUeEvn6TeTu7J8V+BF0_+qJYg6uFZT4Pej+sdLf9kubfg@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

One thing looks possible ( feature not available), just an idea

example/syntax:

BEGIN NOARCHIVE;

--- transaction-1
--- transaction-2
.
.
--- transaction-N

END;

This/These will be performed in Production to clean-up archive which will
not be sync with Archive/DW DB only

one heads-up is Archive/DW DB may need to build WITHOUT CONSTRAINTS

May need to introduce ARCHIVE system/tag in pg_hba.conf

Thanks
Sridhar
OpenText

On Fri, Jun 10, 2016 at 2:22 PM, Craig Ringer <craig(at)2ndquadrant(dot)com> wrote:

> On 10 June 2016 at 16:11, Sridhar N Bamandlapally <sridhar(dot)bn1(at)gmail(dot)com>
> wrote:
>
>> Hi
>>
>> Is there any feature in PostgreSQL where online DW (Dataware housing) is
>> possible ?
>>
>> am looking for scenario like
>>
>> 1. Production DB will have CURRENT + LAST 7 DAYS data only
>>
>> 2. Archive/DW DB will have CURRENT + COMPLETE HISTORY
>>
>> expecting something like streaming, but not ETL
>>
>
> There's nothing built-in, but that's exactly the sort of thing pglogical
> is intended for. You can also build something along those lines with
> Londiste fairly easily.
>
> Hopefully this is the sort of thing we can move toward with built-in
> logical replication in coming releases.
>
> --
> Craig Ringer http://www.2ndQuadrant.com/
> PostgreSQL Development, 24x7 Support, Training & Services
>

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message John R Pierce 2016-06-10 10:56:34 Re: [HACKERS] Online DW
Previous Message Craig Ringer 2016-06-10 08:52:58 Re: Online DW

Browse pgsql-hackers by date

  From Date Subject
Next Message John R Pierce 2016-06-10 10:56:34 Re: [HACKERS] Online DW
Previous Message Amit Langote 2016-06-10 08:55:19 Re: [sqlsmith] Failed assertion in postgres_fdw/deparse.c:1116