Re: persistent read cache

From: Sand Stone <sand(dot)m(dot)stone(at)gmail(dot)com>
To: Steve Atkins <steve(at)blighty(dot)com>
Cc: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: persistent read cache
Date: 2018-02-12 23:22:04
Message-ID: CADrk5qNT_WFa5Z93EPgCrzy+jprw9p8-jD_P4Fhd5wJYWUNU3A@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

Thanks for the info. on bcache etc., first time heard about it. But it
seems quite coarse grained for the needs of a database.

The closest thing might be this implemented by the RocksDB engine:
https://github.com/facebook/rocksdb/wiki/Persistent-Read-Cache

On Mon, Feb 12, 2018 at 9:18 AM, Steve Atkins <steve(at)blighty(dot)com> wrote:
>
>> On Feb 11, 2018, at 5:14 PM, Sand Stone <sand(dot)m(dot)stone(at)gmail(dot)com> wrote:
>>
>>
>> Hi. I wonder if there is such a thing or extension in the PG world.
>>
>> Here is my use case. I am using PG (PG10 to be more specific) in a
>> cloud VM environment. The tables are stored in RAID0 managed SSD
>> backed attached storage. Depending on the VM I am using, I usually
>> have 256GB local SSD unused.
>>
>> I wonder if PG could leverage this local SSD as a read (page/block)
>> cache, to complement/extend the DRAM by used by shared_buffer today.
>
> It seems something that PostgreSQL could take advantage of, but
> it's probably the wrong layer to implement it. If your VM infrastructure
> doesn't have any way to use it directly, maybe you could do it at the
> drive / filesystem level with something like bcache, lvmcache or
> enhanceio?
>
> Adding that sort of complexity to something that needs solid data
> integrity makes me nervous, but those solutions have been in the
> field for years.
>
> Cheers,
> Steve
>
>
>

In response to

Browse pgsql-general by date

  From Date Subject
Next Message greigwise 2018-02-13 00:44:30 Re: pglogical in postgres 9.6
Previous Message Adrian Klaver 2018-02-12 23:19:17 Re: pglogical in postgres 9.6

Browse pgsql-hackers by date

  From Date Subject
Next Message David Fetter 2018-02-12 23:31:14 Re: rename sgml files?
Previous Message Alvaro Herrera 2018-02-12 23:04:01 Re: Minor version upgrades and extension packaging