Where are my tables physically in the fs?

From: Egyud Csaba <csegyud(at)freemail(dot)hu>
To: pgsql-general <pgsql-general(at)postgresql(dot)org>
Subject: Where are my tables physically in the fs?
Date: 2002-12-14 17:38:08
Message-ID: 002c01c2a397$e484e8e0$800a0a0a@xxx
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hi!

I konow, it is a lamer question, but the doc doesn't inculde any details
reguarding the physical storage of db. It is not seriously important for me
just I would like to know.
I use pg7.2.3 on Red Hat 7.1. The provious verson I used was 7.0.3, and it
was easy to find my tables in the fs. The file names told me something -
nearly everything. But now what I can find are only nubers and numbers under
my $PGDATA/base directory.

Once more it isn't too important. If somebody has some time please send me a
url where I can find some more info.

Thanks, and best reguards

Csaba

----- Original Message -----
From: <pgsql-general-owner(at)postgresql(dot)org>
To: <pgsql-general(at)postgresql(dot)org>
Sent: Friday, December 13, 2002 6:51 PM
Subject: [pgsql-general] Daily Digest V1 #2863

> Daily Digest
> Volume 1 : Issue 2863 : "text" Format
>
> Messages in this Issue:
> Re: INDEX suggestion needed
> Re: INDEX suggestion needed
> \dD Bug??
> Re: \dD Bug??
> Re: INDEX suggestion needed
> Re: Urgent need of (paid) PostgreSQL support in New
> Re: \dD Bug??
> Re: Copy/foreign key contraints
> getting datatype of array elements
> Re: getting datatype of array elements
>
> ----------------------------------------------------------------------
>
> Date: Fri, 13 Dec 2002 18:13:49 +0100
> From: Manfred Koizar <mkoi-pg(at)aon(dot)at>
> To: Thomas Beutin <tyrone(at)laokoon(dot)IN-Berlin(dot)DE>
> Cc: pgsql-general(at)postgresql(dot)org
> Subject: Re: INDEX suggestion needed
> Message-ID: <9d4kvusca8dakffi13s0m0no8um8ijs1bv(at)4ax(dot)com>
>
> On Fri, 13 Dec 2002 16:41:38 +0100, Thomas Beutin
> <tyrone(at)laokoon(dot)IN-Berlin(dot)DE> wrote:
> >> >(visit >= '2002-10-01' AND visit <= '2002-10-31') index scan, but long
(>5sec)
> >>
> >> Ca. 3%; interesting that it takes so long; I'd like to see EXPLAIN
>
> Oops! Should be 10% according to the last two histogram bounds:
> >> > "2002-09-29 09:09:31+02"
> >> > "2002-10-29 23:25:13+01"
>
> >> ANALYZE output for enable_seqscan on and off.
> >There is no difference in cost.
>
> Oops again! If it's already using an index scan, switching seqscan
> off won't change anything. I should have meant "for enable_indexscan
> on and off".
>
>
> >> The negative correlation looks strange. How did you insert your data?
> >It is a dump from the production system, and the production system gets
> >the data once a day from webserver logs line by line.
>
> Did you insert in reverse order (newest first)?
>
> | most_common_freqs = {0.000666667,...,0.000666667}
>
> These values occurred exactly twice in the analyzer's sample of 3000
> values, so for the accuracy we need here it's ok to ignore them.
>
> Servus
> Manfred
>
> ------------------------------
>
> Date: Fri, 13 Dec 2002 18:37:59 +0100
> From: Manfred Koizar <mkoi-pg(at)aon(dot)at>
> To: Alvaro Herrera <alvherre(at)dcc(dot)uchile(dot)cl>
> Cc: Thomas Beutin <tyrone(at)laokoon(dot)IN-Berlin(dot)DE>,
> pgsql-general(at)postgresql(dot)org
> Subject: Re: INDEX suggestion needed
> Message-ID: <ja5kvuo09052ldtp94maadc7shmhr5vg6t(at)4ax(dot)com>
>
> On Fri, 13 Dec 2002 13:00:14 -0300, Alvaro Herrera
> <alvherre(at)dcc(dot)uchile(dot)cl> wrote:
> >Now this catched my attention (in the questions' side, sorry, not the
> >answers'). Why the aggregate takes 10 times the time needed for the
> >indexscan?
>
> Good point!
>
> > One would think that a function like count() should be
> >pretty cheap,
>
> COUNT is cheap. But COUNT(DISTINCT something) is not trivial, it has
> to keep a list of all values it has already counted. I didn't look at
> the implementation. Do we have O(n^2) cost here?
>
> Thomas, could you EXPLAIN ANALYZE some test cases with
>
> SELECT COUNT(*) FROM (
> SELECT DISTINCT a_id
> FROM stat_pages
> WHERE ...
> ) AS x;
>
> and compare them to the results of SELECT COUNT(DISTINCT ...)?
>
> So now you are back where you started. At least you have an index on
> "visit" now ;-)
>
> Servus
> Manfred
>
> ------------------------------
>
> Date: Fri, 13 Dec 2002 09:57:47 -0800
> From: Steve Crawford <scrawford(at)pinpointresearch(dot)com>
> To: pgsql-general(at)postgresql(dot)org
> Subject: \dD Bug??
> Message-ID: <20021213175747(dot)859CF103BD(at)polaris(dot)pinpointresearch(dot)com>
>
> Is this a known bug? I created a database (test) and two schemas (s1 and
s2)
> each of which have one table (s1.test and s2.test) but when I use \dD I
see
> no schemas listed:
>
> test=# select * from s1.test;
> x
> -----------------
> I am in s1.test
> (1 row)
>
> test=# select * from s2.test;
> x
> -----------------
> I am in s2.test
> (1 row)
>
> test=# \dD
> List of domains
> Schema | Name | Type | Modifier
> --------+------+------+----------
> (0 rows)
>
> Cheers,
> Steve
>
> ------------------------------
>
> Date: Fri, 13 Dec 2002 13:16:28 -0500
> From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
> To: Steve Crawford <scrawford(at)pinpointresearch(dot)com>
> Cc: pgsql-general(at)postgresql(dot)org
> Subject: Re: \dD Bug??
> Message-ID: <5053(dot)1039803388(at)sss(dot)pgh(dot)pa(dot)us>
>
> Steve Crawford <scrawford(at)pinpointresearch(dot)com> writes:
> > Is this a known bug? I created a database (test) and two schemas (s1 and
s2)
> > each of which have one table (s1.test and s2.test) but when I use \dD I
see
> > no schemas listed:
>
> \dD is for domains, not schemas. There isn't a \d command for schemas
> in 7.3.
>
> regards, tom lane
>
> ------------------------------
>
> Date: Fri, 13 Dec 2002 13:23:50 -0500
> From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
> To: Manfred Koizar <mkoi-pg(at)aon(dot)at>
> Cc: Alvaro Herrera <alvherre(at)dcc(dot)uchile(dot)cl>,
> Thomas Beutin <tyrone(at)laokoon(dot)IN-Berlin(dot)DE>,
> pgsql-general(at)postgresql(dot)org
> Subject: Re: INDEX suggestion needed
> Message-ID: <6412(dot)1039803830(at)sss(dot)pgh(dot)pa(dot)us>
>
> Manfred Koizar <mkoi-pg(at)aon(dot)at> writes:
> > COUNT is cheap. But COUNT(DISTINCT something) is not trivial, it has
> > to keep a list of all values it has already counted. I didn't look at
> > the implementation. Do we have O(n^2) cost here?
>
> No, more like O(n ln n) --- it's a sort/uniq implementation.
>
> regards, tom lane
>
> ------------------------------
>
> Date: 13 Dec 2002 13:40:19 -0500
> From: Vivek Khera <khera(at)kcilink(dot)com>
> To: pgsql-general(at)postgresql(dot)org
> Subject: Re: Urgent need of (paid) PostgreSQL support in New
> Message-ID: <x7lm2t69v0(dot)fsf(at)onceler(dot)kciLink(dot)com>
>
> >>>>> "TL" == Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> writes:
>
> TL> There are varying opinions about that. Some say "push PG's
> TL> shared-buffers setting as high as you can make it". Some say "use a
> TL> conservatively small shared-buffers setting and expect the kernel to
use
> TL> the rest of physical memory as kernel disk buffers". But both camps
>
> I think that once your DB size gets big enough, there will be queries
> that suck no matter what, because you have to scan through a boatload
> of disk pages. Basically, once your working set size is bigger than
> the shared buffer space, you're hosed. Making shared buffer space
> bigger than 50% of RAM will suck, as Tom said. I used to do that, now
> I have about 25-30% of RAM as shared bufs. It still sucks because the
> data size is too big. I've got the fastest disks I can get, and split
> the data across multiple spindles using RAID5 (yes, I could probably
> get faster with RAID 1+0 or something, but it is too late for that
> now...)
>
>
> --
> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
> Vivek Khera, Ph.D. Khera Communications, Inc.
> Internet: khera(at)kciLink(dot)com Rockville, MD +1-240-453-8497
> AIM: vivekkhera Y!: vivek_khera http://www.khera.org/~vivek/
>
> ------------------------------
>
> Date: Fri, 13 Dec 2002 11:47:49 -0800
> From: Steve Crawford <scrawford(at)pinpointresearch(dot)com>
> To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
> Cc: pgsql-general(at)postgresql(dot)org
> Subject: Re: \dD Bug??
> Message-ID: <20021213194751(dot)BCA27103BD(at)polaris(dot)pinpointresearch(dot)com>
>
> Oops, my mistake.
>
> -Steve
>
> On Friday 13 December 2002 10:16 am, Tom Lane wrote:
> > Steve Crawford <scrawford(at)pinpointresearch(dot)com> writes:
> > > Is this a known bug? I created a database (test) and two schemas (s1
and
> > > s2) each of which have one table (s1.test and s2.test) but when I use
\dD
> > > I see no schemas listed:
> >
> > \dD is for domains, not schemas. There isn't a \d command for schemas
> > in 7.3.
> >
> > regards, tom lane
> >
> > ---------------------------(end of broadcast)---------------------------
> > TIP 2: you can get off all lists at once with the unregister command
> > (send "unregister YourEmailAddressHere" to majordomo(at)postgresql(dot)org)
>
> ------------------------------
>
> Date: Fri, 13 Dec 2002 15:35:32 -0700
> From: "Ken Godee" <ken(at)perfect-image(dot)com>
> To: rstpierre(at)syscor(dot)com, pgsql-general(at)postgresql(dot)org
> Subject: Re: Copy/foreign key contraints
> Message-ID: <3DF9FE43(dot)31079(dot)43557A(at)localhost>
>
> Ron,
> The file I'm COPYing is straight ascii data, and just delimited
> no sql statements, I'm adding data to an existing table.
>
> ie.
> ------file-----------
> 25467^John Doe^480-555-1212^^12/13/2002
> ---------------------
>
> "COPY transx from '/tmp/transx.dat' delimiters '^' with null as '';
>
> I had thought this was pretty straight forward, I don't
> have a very complex set up and thought I was just missing
> something (and probally am) or this was a common problem.
> Another poster suggested forwarding alittle more info and
> schema to list, which I'll post a little later.
>
>
>
> > OOPS, correction as:
> > Also, if names are NOT double quoted "custID" any reference to them get
> > converted to lower case, so you're references must be case-correct too.
> > eg CONSTRAINT "mycon" FOREIGN KEY ("custID") REFERENCES .....
> >
> >
> > Ron St.Pierre wrote:
> >
> > > Check your ascii file and make sure that the column or constraint
> > > names are not quoted. If so, check for spaces at the end of names
> > > eg CONSTRAINT 'mycon' FOREIGN KEY ('custid ') REFERENCES ...... <-
> > > note the space inside quotes after custid
> > >
> > > Also, if names are double quoted "custID" any reference to them get
> > > converted to lower case, so you're references must be case-correct
too.
> > > eg CONSTRAINT "mycon" FOREIGN KEY ("custID") REFERENCES .....
> > >
> > >
> > >
> > > Ken Godee wrote:
> > >
> > >> The data's not originally coming from a postgres database,
> > >> it's in a ascii delimited format, sorry for not mentioning that.
> > >>
> > >>
> > >>> Ken Godee wrote:
> > >>>
> > >>>
> > >>>> table 1: customer.custid primary key
> > >>>> table 2: transx.custid foreign key
> > >>>>
> > >>>> When using COPY to import data I received;
> > >>>>
> > >>>> "<unnamed>referential integerity violation-key referenced from
> > >>>> table transx not found in customer" (fairly vague statement)
> > >>>>
> > >>>>
> > >>>
> > >>
> > >>
> > >> ---------------------------(end of
broadcast)---------------------------
> > >> TIP 3: if posting/reading through Usenet, please send an appropriate
> > >> subscribe-nomail command to majordomo(at)postgresql(dot)org so that your
> > >> message can get through to the mailing list cleanly
> > >>
> > >>
> > >
> > >
> >
> >
> > --
> > Ron St.Pierre
> > Syscor R&D
> > tel: 250-361-1681
> > email: rstpierre(at)syscor(dot)com
> >
> >
> >
>
>
>
> ------------------------------
>
> Date: 13 Dec 2002 23:53:21 +0100
> From: Moritz Sinn <moritz(at)freesources(dot)org>
> To: pgsql-general(at)postgresql(dot)org
> Subject: getting datatype of array elements
> Message-ID: <87y96tmsym(dot)fsf(at)appserv(dot)sinnhq(dot)de>
>
>
> hi,
>
> with the following statement, i get the datatype of a column with help of
> its name and the tableoid:
>
> SELECT typname FROM pg_attribute LEFT JOIN pg_type ON atttypid=typelem
> WHERE attrelid=18210 AND attname='email';
>
> but if the columns datatyp is an array, that doesn't work.
> i'd like to get the basic datatype (the datatype of the array elements)
then.
>
> any ideas?
>
> thanks,
> moritz
>
> --
>
> ------------------------------
>
> Date: Fri, 13 Dec 2002 18:49:59 -0800
> From: Joe Conway <mail(at)joeconway(dot)com>
> To: Moritz Sinn <moritz(at)freesources(dot)org>
> Cc: pgsql-general(at)postgresql(dot)org
> Subject: Re: getting datatype of array elements
> Message-ID: <3DFA9C57(dot)3060904(at)joeconway(dot)com>
>
> Moritz Sinn wrote:
> > hi,
> >
> > with the following statement, i get the datatype of a column with help
of
> > its name and the tableoid:
> >
> > SELECT typname FROM pg_attribute LEFT JOIN pg_type ON atttypid=typelem
> > WHERE attrelid=18210 AND attname='email';
> >
> > but if the columns datatyp is an array, that doesn't work.
> > i'd like to get the basic datatype (the datatype of the array elements)
then.
>
> See typelem:
>
http://www.us.postgresql.org/users-lounge/docs/7.3/postgres/catalog-pg-type.
html
>
> HTH,
>
> Joe
>
>
>
> ------------------------------
>
> End of [pgsql-general] Daily Digest V1 #2863
> **********
>
>
>

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.427 / Virus Database: 240 - Release Date: 2002.12.06.

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Reynard Hilman 2002-12-14 20:43:37 index not being used
Previous Message Devrim GÜNDÜZ 2002-12-14 16:56:24 Re: [GENERAL] PostgreSQL Global Development Group