From: | Toshiba via PostgreSQL Announce <announce-noreply(at)postgresql(dot)org> |
---|---|
To: | PostgreSQL Announce <pgsql-announce(at)lists(dot)postgresql(dot)org> |
Subject: | PGSpider extention is newly released |
Date: | 2021-08-30 00:13:19 |
Message-ID: | 163028239967.699.2063754562393441605@wrigleys.postgresql.org |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-announce |
We have just newly released PGSpider extension(pgspider_ext).<br>
<br>
This is an extension to construct High-Performance SQL Cluster Engine for distributed big data.<br>
PGSpider enables PostgreSQL to access a number of data sources using Foreign Data Wrapper(FDW) and retrieves the distributed data source vertically.
The main feature is:<br>
* Node partitioned table<br>
User can get records in multi tables on some data sources by one SQL easily.
<br>
If there are 2 data sources which have the following records:<br>
SELECT * FROM t1_node1; -- @node1
i | t
----+---
10 | a
11 | b
(2 rows)
SELECT * FROM t1_node2; -- @node2
i | t
----+---
20 | c
21 | d
(2 rows)
PGSpider enables to collect these records with node identifier column like:
SELECT * FROM t1;
i | t | node
----+---+-------
10 | a | node1
11 | b | node1
20 | c | node2
21 | d | node2
(4 rows)
- Parallel processing<br>
PGSpider can fetch results from data sources in parallel.
- Pushdown<br>
PGSpider can pushdown WHERE clause and aggregation functions to data sources.<br>
The shippability depends on datasource FDW.<br>
<br>
This is developed by Toshiba Software Engineering & Technology Center.<br>
Source repository : https://github.com/pgspider/pgspider_ext
Best Regards,<br>
Mototaka Kanematsu
From | Date | Subject | |
---|---|---|---|
Next Message | PWN via PostgreSQL Announce | 2021-08-30 06:57:19 | PostgreSQL Weekly News - August 29, 2021 |
Previous Message | Red Hat via PostgreSQL Announce | 2021-08-30 00:12:40 | pgmoneta 0.5.0 |