Re: Pluggable storage

On Sat, Aug 26, 2017 at 1:34 PM, Haribabu Kommi <kommi(dot)haribabu(at)gmail(dot)com>
wrote:

>
> I will submit the new patch series with all comments given
> in the upthread to the upcoming commitfest.
>

Here I attached new set of patches that are rebased to the latest master.

0001-Change-Create-Access-method-to-include-storage-handl:

Add the support of storage method to create as part of create
access method syntax.

0002-Storage-AM-API-hooks-and-related-functions:

The necessary storage AM API hooks that are required
to support pluggable storage API and supporting functions
to frame the storage routine.

0003-Adding-storageam-hanlder-to-relation-structure:

Add the storageAm routine pointer to relation structure
and necessary functions to initialize the storage AM routine
whenever the relation is built.

0004-Adding-tuple-visibility-function-to-storage-AM:

The tuple visibility functions are moved into heap storage AM
and the visibility function in snapshot structure is changed from
function pointer to an enum to indicate what type of snapshot
it is. Based on that enum, the corresponding visibility function
is executed from the relation storage AM routine.

0005-slot-hooks-are-added-to-storage-AM:

The slot specific storage AM routine pointer is added to slot
structure and removed some of the members and created
a new HeapamSlot structure to hold the necessary tuple
information. Currently the slot supports the minimal tuple
also.

Currently this patch may further needs some changes as it
assumes the tuple is in HeapTuple format in some API's.
This slot storage AM routine may be common to all the
pluggable storage modules.

0006-Tuple-Insert-API-is-added-to-Storage-AM:

The write support functionality is added to storage AM.
And also all the storage AM functions are extracted into
another file to make it easier to understand while writing
and changing the code to support new API's.

0007-Scan-functions-are-added-to-storage-AM:

All the scan supported functions are added to storage AM.
And these functions are also extracted into storageam.c file.

Pending comments from Andres:
1. Remove the usage of HeapScanDesc.
2. Remove the usage of scan_getpage, scan_update_snapshot
and scan_rescan_set_params hooks.
3. Many places the relation is not available while creating the slot,
and also slot shouldn't depend on relation, because the slot values
are may be some times from two different storage relations also.
So I modified the slot code to use the same storage mechanism.
4.Tuples functionality moving into a separate folder.

Other pending activities are:
1. Handle Bitmap and sample scans as they dependent on heap format.
2. Add some configuration flags in the storage AM, based on these flags
whether vacuum can run on these relations or not will be decided. This
may be further enhanced to provide the cost parameters also that can be
used for planning.

I attached individual patches in the mail, in case if it increases the mail
size,
or creates problems to some one, i will attach the zip version from next
time
onward.

Regards,
Hari Babu
Fujitsu Australia