Re: Postgresql 9.6 and Big Data

From: John R Pierce <pierce(at)hogranch(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: Postgresql 9.6 and Big Data
Date: 2016-12-02 19:11:39
Message-ID: ec672895-732b-4826-fcb9-fcec6d9e7f7a@hogranch.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 12/2/2016 12:19 AM, Job wrote:
> We need to archive this data to generate report and analysis views.

on top of what Stephen said, I'd do as much preprocessing, and
preaggregation as possible to simplify and speed up those
report/analysis views.... for instance, storing min/max/mean rollups
per hour, per day, per month could mean the difference between a billion
row seq scan that takes hours and a few second query to graph a given
time range.

--
john r pierce, recycling bits in santa cruz

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Adrian Klaver 2016-12-02 21:45:59 Re: INSERT - UPDATE throughput oscillating and SSD activity after stopping the client
Previous Message Fabricio Pedroso Jorge 2016-12-02 18:54:57 Re: Create DB ends with error "FATAL: Ident authentication failed for user "postgres""