pg_dump/restore problems

--00504502b0a37a169e047fa7bc33
Content-Type: text/plain; charset=ISO-8859-1

I am not sure where I should post this but I am running into problems trying
to restore a large table. I am running 8.4.1 on all servers. The table is
about 25gb in size and most of that is toasted. It has about 2.5m records.
When I dump this table using pg_dump -Fc it creates a 15 gb file. I am
trying to restore in into a database that has 100gb of free disk space and
it consumes it all and fails to finish the restore. The table is not
partitioned and has a few indexes on it. What can I do?

thanks
-glen

Glen Brown

--00504502b0a37a169e047fa7bc33
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div>I am not sure where I should post this but I am running into problems =
trying to restore a large table. I am running 8.4.1 on all servers. The tab=
le is about 25gb in size and most of that is toasted. It has about 2.5m rec=
ords. When I dump this table using pg_dump -Fc it creates a 15 gb file. I a=
m trying to restore in into a database that has 100gb of free disk space an=
d it consumes it all and fails to finish the restore. The table is not part=
itioned and has a few indexes on it. What can I do?</div>

<div>=A0</div>
<div>thanks</div>
<div>-glen</div>
<div><br clear=3D"all">Glen Brown<br></div>

--00504502b0a37a169e047fa7bc33--
Glen Brown [ Mo, 15 Februar 2010 19:25 ] [ ID #2032329 ]

Re: pg_dump/restore problems

Glen Brown wrote:

> When I dump this table using pg_dump -Fc it creates a 15 gb file. I
> am trying to restore in into a database that has 100gb of free disk
> space and it consumes it all and fails to finish the restore.

What is the platform? (I remember having problems with large file
handling in PostgreSQL on Windows, back when I used Windows.)

Can you see where the space is going when this happens?

-Kevin



--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Kevin Grittner [ Sa, 20 Februar 2010 18:52 ] [ ID #2032949 ]

Re: pg_dump/restore problems

--001636b42f4074246304800e3938
Content-Type: text/plain; charset=ISO-8859-1

I am using Ubuntu 8LTS on both systems. How can tell where the space is
going?

thanks for the help
-glen

Glen Brown


On Sat, Feb 20, 2010 at 9:52 AM, Kevin Grittner <Kevin.Grittner [at] wicourts.gov
> wrote:

> Glen Brown wrote:
>
> > When I dump this table using pg_dump -Fc it creates a 15 gb file. I
> > am trying to restore in into a database that has 100gb of free disk
> > space and it consumes it all and fails to finish the restore.
>
> What is the platform? (I remember having problems with large file
> handling in PostgreSQL on Windows, back when I used Windows.)
>
> Can you see where the space is going when this happens?
>
> -Kevin
>
>
>

--001636b42f4074246304800e3938
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div>I am using Ubuntu 8LTS on both systems. How can tell where the space i=
s going? </div>
<div>=A0</div>
<div>thanks for the help</div>
<div>-glen</div>
<div><br clear=3D"all">Glen Brown<br><br><br></div>
<div class=3D"gmail_quote">On Sat, Feb 20, 2010 at 9:52 AM, Kevin Grittner =
<span dir=3D"ltr"><<a href=3D"mailto:Kevin.Grittner [at] wicourts.gov">Kevin.=
Grittner [at] wicourts.gov</a>></span> wrote:<br>
<blockquote style=3D"BORDER-LEFT: #ccc 1px solid; MARGIN: 0px 0px 0px 0.8ex=
; PADDING-LEFT: 1ex" class=3D"gmail_quote">
<div class=3D"im">Glen Brown =A0wrote:<br><br>> When I dump this table u=
sing pg_dump -Fc it creates a 15 gb file. I<br>> am trying to restore in=
into a database that has 100gb of free disk<br>> space and it consumes =
it all and fails to finish the restore.<br>
<br></div>What is the platform? =A0(I remember having problems with large f=
ile<br>handling in PostgreSQL on Windows, back when I used Windows.)<br><br=
>Can you see where the space is going when this happens?<br><font color=3D"=
#888888"><br>
-Kevin<br><br><br></font></blockquote></div><br>

--001636b42f4074246304800e3938--
Glen Brown [ Sa, 20 Februar 2010 21:41 ] [ ID #2032950 ]

Re: pg_dump/restore problems

Glen Brown wrote:

> I am using Ubuntu 8LTS on both systems. How can tell where the
> space is going?

Maybe someone has a more sophisticated way, but I'd be poking around
with "du -shx" requests against the contents of various directories
during the run. Maybe run "vmstat 1" in another shell, piping the
results to a file.

-Kevin

--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Kevin Grittner [ So, 21 Februar 2010 02:59 ] [ ID #2032954 ]

Re: pg_dump/restore problems

On Sat, Feb 20, 2010 at 6:59 PM, Kevin Grittner
<Kevin.Grittner [at] wicourts.gov> wrote:
> Glen Brown =A0wrote:
>
>> I am using Ubuntu 8LTS on both systems. How can tell where the
>> space is going?
>
> Maybe someone has a more sophisticated way, but I'd be poking around
> with "du -shx" requests against the contents of various directories
> during the run. =A0Maybe run "vmstat 1" in another shell, piping the
> results to a file.

Also look at iotop. Pretty sure it'll work on an up to date ubuntu 8.04 LT=
S.

--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Scott Marlowe [ So, 21 Februar 2010 03:35 ] [ ID #2032959 ]
Datenbanken » gmane.comp.db.postgresql.admin » pg_dump/restore problems

Vorheriges Thema: C trigger problem : conversion of CString to Datum
Nächstes Thema: Backups