PG_dump a large database fails

--0016e646987284558e04881c476c
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi

For migration purpose (from 8.2 to 8.4), i'm trying to make a dump of a 16
GB database.
(this is my dump command "pg_dump mydb | gzip > /var/dump/db.gz"

It fails whith this error message:
pg_dump: la commande SQL a =C3=A9chou=C3=A9
pg_dump: Message d'erreur du serveur : ERREUR: invalid memory alloc reques=
t
size 1510382321
pg_dump: La commande =C3=A9tait : COPY public.attach_data (id, thedata) TO
stdout;

i executed this command to wich row exceed this size,
SELECT id, octet_length(thedata) as taille FROM attach_data WHERE
octet_length(thedata)>1510382321 ORDER BY 2 DESC;
id | taille
----+--------
(0 ligne)

Here we can see that there is no row greater than 1510382321

but i found rows exceeding 440 MB. i deleted them.

Now the dump stopped with the same error but with a different size

pg_dump: la commande SQL a =C3=A9chou=C3=A9
pg_dump: Message d'erreur du serveur : ERREUR: invalid memory alloc reques=
t
size 1146242327
pg_dump: La commande =C3=A9tait : COPY public.attach_data (id, thedata) TO
stdout;

Can you give me some advices on how can i do the dump ?

Thanks a lot

--0016e646987284558e04881c476c
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi <br><br>For migration purpose (from 8.2 to 8.4), i'm trying to make =
a dump of a 16 GB database. <br>(this is my dump command "pg_dump mydb=
| gzip > /var/dump/db.gz"<br><br>It fails whith this error message=
:<br>
pg_dump: la commande SQL a =C3=A9chou=C3=A9<br>pg_dump: Message d'erreu=
r du serveur : ERREUR:=C2=A0 invalid memory alloc request size 1510382321<b=
r>pg_dump: La commande =C3=A9tait : COPY public.attach_data (id, thedata) T=
O stdout;<br><br>
i executed this command to wich row exceed this size, <br>SELECT id, octet_=
length(thedata) as taille FROM attach_data WHERE octet_length(thedata)>1=
510382321 ORDER BY 2 DESC;<br>=C2=A0id | taille <br>----+--------<br>(0 lig=
ne)<br>
<br>Here we can see that there is no row greater than 1510382321<br><br>but=
i found rows exceeding 440 MB. i deleted them. <br><br>Now the dump stoppe=
d with the same error but with a different size <br><br>pg_dump: la command=
e SQL a =C3=A9chou=C3=A9<br>
pg_dump: Message d'erreur du serveur : ERREUR:=C2=A0 invalid memory all=
oc request size 1146242327<br>pg_dump: La commande =C3=A9tait : COPY public=
..attach_data (id, thedata) TO stdout;<br><br>Can you give me some advices o=
n how can i do the dump ? <br>
<br>Thanks a lot <br><br><br>

--0016e646987284558e04881c476c--
fida aljounaidi [ Do, 03 Juni 2010 10:49 ] [ ID #2042559 ]

Re: PG_dump a large database fails

fida aljounaidi <fida.aljounaidi [at] gmail.com> wrote:

> For migration purpose (from 8.2 to 8.4)

8.2.what? to 8.4.what?

> (this is my dump command "pg_dump mydb | gzip > /var/dump/db.gz"

Using pg_dump from which version?

> It fails whith this error message:
> pg_dump: la commande SQL a =E9chou=E9
> pg_dump: Message d'erreur du serveur : ERREUR: invalid memory
> alloc request size 1510382321
> pg_dump: La commande =E9tait : COPY public.attach_data (id, thedata)
> TO stdout;

Did you (or can you) get a core file and get a backtrace?

-Kevin

--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Kevin Grittner [ Do, 03 Juni 2010 15:49 ] [ ID #2042561 ]
Datenbanken » gmane.comp.db.postgresql.admin » PG_dump a large database fails

Vorheriges Thema: default isolation level per user?
Nächstes Thema: Restore DataBase