| From: | "Merlin Moncure" <merlin(dot)moncure(at)rcsonline(dot)com> |
|---|---|
| To: | <josh(at)agliodbs(dot)com> |
| Cc: | <pgsql-hackers(at)postgresql(dot)org>, <pgsql-performance(at)postgresql(dot)org> |
| Subject: | Re: [PERFORM] OSS database needed for testing |
| Date: | 2003-04-04 18:00:26 |
| Message-ID: | 303E00EBDD07B943924382E153890E5434A93C@cuthbert.rcsinc.local |
| Views: | Whole Thread | Raw Message | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers pgsql-performance |
Josh Berkus wrote:
> Cool. I'll tackle this in a week or two. Right now, I'm being paid
to
> convert a client's data and that'll keep me busy through the weekend
...
I would suggest downloading the data now. I can help get you started
with the create table statements and the import scripts. There are not
very many ways to get the data in a reasonable timeframe: the spi
functions or the copy command are a good place to start. Do not bother
with running stuff through insert queries: take my word for it, it just
won't work. Of course, if you use copy, you have to pre-format. Be
aware that you will have many gigabytes (like more than 20) of data
before you are done.
Whatever you decide to do, document the process: the difficulty of
getting large amounts of data into postgres quickly and easily has been
a historical complaint of mine. Using mysql, it was a snap to get the
data in but using *that* database I really felt it couldn't handle this
much data.
I can also get you started with some example queries that should be
quite a challenge to set up to run quickly. After that, it's your
ballgame.
Merlin
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Josh Berkus | 2003-04-04 18:07:49 | Re: OSS database needed for testing |
| Previous Message | Josh Berkus | 2003-04-04 17:37:34 | Re: [PERFORM] OSS database needed for testing |
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Josh Berkus | 2003-04-04 18:07:49 | Re: OSS database needed for testing |
| Previous Message | Josh Berkus | 2003-04-04 17:37:34 | Re: [PERFORM] OSS database needed for testing |