AIX 5.3 Out of Memory Error - 64-bit

This is a multi-part message in MIME format.

------_=_NextPart_001_01CA7A67.8D61C288
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi All

I'm looking for some help with regards a postgres 64-bit install I set
up on a IBM AIX machine.

I used the following install options whien I installed postgres

BINDIR =3D /usr/local/pgsql837-64/bin

DOCDIR =3D /usr/local/pgsql837-64/doc

INCLUDEDIR =3D /usr/local/pgsql837-64/include

PKGINCLUDEDIR =3D /usr/local/pgsql837-64/include

INCLUDEDIR-SERVER =3D /usr/local/pgsql837-64/include/server

LIBDIR =3D /usr/local/pgsql837-64/lib

PKGLIBDIR =3D /usr/local/pgsql837-64/lib

LOCALEDIR =3D

MANDIR =3D /usr/local/pgsql837-64/man

SHAREDIR =3D /usr/local/pgsql837-64/share

SYSCONFDIR =3D /usr/local/pgsql837-64/etc

PGXS =3D /usr/local/pgsql837-64/lib/pgxs/src/makefiles/pgxs.mk

CONFIGURE =3D '--prefix=3D/usr/local/pgsql837-64' '--with-pgport=3D5422'
'--enable-thr
ead-safety' '--enable-integer-datetimes' 'CC=3Dgcc -maix64'
'LDFLAGS=3D-Wl,-bbigtoc'
CC =3D gcc -maix64

CPPFLAGS =3D

CFLAGS =3D -O2 -Wall -Wmissing-prototypes -Wpointer-arith -Winline
-Wdeclaration-a
fter-statement -Wendif-labels -fno-strict-aliasing -fwrapv

CFLAGS_SL =3D

LDFLAGS =3D -Wl,-bbigtoc
-Wl,-blibpath:/usr/local/pgsql837-64/lib:/usr/lib:/lib
LDFLAGS_SL =3D -Wl,-bnoentry -Wl,-H512 -Wl,-bM:SRE

LIBS =3D -lpgport -lz -lreadline -lld -lm

VERSION =3D PostgreSQL 8.3.7

And the spec of the AIX machine is a follows.

AIX 5.3
2x Power 5 CPU's
6GB RAM

If I run postgres with the standard postgresql.conf install then all
queries run (albiet sometimes slower than i'd expect). However if I
start to change some of the memory settings for example shared_buffers,
temp_buffers, work_mem, maintenance_workmem above 128-256MB and run a
large query or create a large indexes i get the error below

Out of Memory
Failed on request of size 167873 (this value will change)

Any thoughts or ideas would be greatly appreciated

Thanks
Fran =2 0 =


___________________________________________________

This email is intended for the named recipient. The information contained=

in it is confidential. You should not copy it for any purposes, nor
disclose its contents to any other party. If you received this email
in error, please notify the sender immediately via email, and delete it from
your computer.

Any views or opinions presented are solely those of the author and do not=

necessarily represent those of the company.

Cromwell Tools Limited, PO Box 14, 65 Chartwell Drive
Wigston, Leicester LE18 1AT. Tel 0116 2888000
Registered in England and Wales, Reg No 00986161
VAT GB 115 5713 87 900
__________________________________________________


------_=_NextPart_001_01CA7A67.8D61C288
Content-Type: text/html;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; charset=3Dus-ascii">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version 6.5.7638.1">
<TITLE>AIX 5.3 Out of Memory Error - 64-bit</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/rtf format -->

<P><FONT SIZE=3D2 FACE=3D"Times New Roman">Hi All</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Times New Roman">I'm looking for some help with r=
egards a postgres 64-bit install I  set up on a IBM AIX machine.</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Times New Roman">I used the following install opt=
ions whien I installed postgres</FONT>
</P>

<P><B><FONT SIZE=3D2 FACE=3D"Times New Roman">BINDIR =3D /usr/local/pgsql83=
7-64/bin           &=
nbsp;           &nbs=
p;            &=
nbsp;        </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">DOCDIR =3D /usr/local/pgsql8=
37-64/doc           =
            &nb=
sp;            =
         </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">INCLUDEDIR =3D /usr/local/pg=
sql837-64/include         &nbs=
p;            &=
nbsp;           &nbs=
p;  </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">PKGINCLUDEDIR =3D /usr/local=
/pgsql837-64/include         &=
nbsp;           &nbs=
p;            </FONT=
></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">INCLUDEDIR-SERVER =3D /usr/l=
ocal/pgsql837-64/include/server       &n=
bsp;            =
;   </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">LIBDIR =3D /usr/local/pgsql8=
37-64/lib           =
            &nb=
sp;            =
         </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">PKGLIBDIR =3D /usr/local/pgs=
ql837-64/lib          &nb=
sp;            =
            &nb=
sp;      </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">LOCALEDIR =3D  &nb=
sp;            =
            &nb=
sp;            =
            &nb=
sp;            =
    </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">MANDIR =3D /usr/local/pgsql8=
37-64/man           =
            &nb=
sp;            =
         </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">SHAREDIR =3D /usr/local/pgsq=
l837-64/share          &n=
bsp;            =
;            &n=
bsp;     </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">SYSCONFDIR =3D /usr/local/pg=
sql837-64/etc          &n=
bsp;            =
;            &n=
bsp;     </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">PGXS =3D /usr/local/pgsql837=
-64/lib/pgxs/src/makefiles/pgxs.mk<I>      &n=
bsp;            =
; </I></FONT></B>

<BR><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">CONFIGURE =3D '--prefix=
=3D/usr/local/pgsql837-64' '--with-pgport=3D5422' '--enable-thr</FONT></I><=
/B>

<BR><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">ead-safety' '--enable-int=
eger-datetimes' 'CC=3Dgcc -maix64' 'LDFLAGS=3D-Wl,-bbigtoc'</FONT></I></B>

<BR><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">CC =3D gcc -maix64 &=
nbsp;           &nbs=
p;            &=
nbsp;           &nbs=
p;            &=
nbsp;            </F=
ONT></I></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">CPPFLAGS =3D  &nbs=
p;            &=
nbsp;           &nbs=
p;            &=
nbsp;           &nbs=
p;            &=
nbsp;    </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">CFLAGS =3D -O2 -Wall -Wmissi=
ng-prototypes -Wpointer-arith -Winline -Wdeclaration-a</FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">fter-statement -Wendif-label=
s -fno-strict-aliasing -fwrapv       &nb=
sp;            =
  </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">CFLAGS_SL =3D  &nb=
sp;            =
            &nb=
sp;            =
            &nb=
sp;            =
    </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">LDFLAGS =3D -Wl,-bbigtoc -Wl=
,-blibpath:/usr/local/pgsql837-64/lib:/usr/lib:/lib   </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">LDFLAGS_SL =3D -Wl,-bnoentry=
-Wl,-H512 -Wl,-bM:SRE         =
;            &n=
bsp;          </FONT></B>

<BR><B><FONT SIZE=3D2 FACE=3D"Times New Roman">LIBS =3D -lpgport -lz -lread=
line -lld -lm</FONT><I><FONT SIZE=3D2 FACE=3D"Times New Roman">  =
            &nb=
sp;            =
            &nb=
sp; </FONT></I></B>

<BR><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">VERSION =3D PostgreSQL 8.=
3.7   </FONT></I></B>
</P>

<P><FONT SIZE=3D2 FACE=3D"Times New Roman">And the spec of the AIX machine =
is a follows.</FONT>
</P>

<P><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">AIX 5.3</FONT></I></B>

<BR><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">2x Power 5 CPU's</FONT></=
I></B>

<BR><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">6GB RAM</FONT></I></B>
</P>

<P><FONT SIZE=3D2 FACE=3D"Times New Roman">If I run postgres with the stand=
ard postgresql.conf install then all queries run (albiet sometimes slower t=
han i'd expect).  However if I start to change some of the memory sett=
ings for example shared_buffers, temp_buffers, work_mem, maintenance_workme=
m above 128-256MB and run a large query or create a large indexes i get the=
error below</FONT></P>

<P><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">Out of Memory</FONT></I></=
B>

<BR><B><I><FONT SIZE=3D2 FACE=3D"Times New Roman">Failed on request of size=
167873 (this value will change)</FONT></I></B>
</P>

<P><FONT SIZE=3D2 FACE=3D"Times New Roman">Any thoughts or ideas would be g=
reatly appreciated </FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Times New Roman">Thanks</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Times New Roman">Fran    &nb=
sp;   </FONT> <FONT FACE=3D"Times New Roman">  &nb=
sp;           </FONT=
>
</P>

</BODY>

___________________________________________________



This email is intended for the named recipient. The information conta=
ined

in it is confidential. You should not copy it for any purposes, nor=


disclose its contents to any other party. If you received this email=


in error, please notify the sender immediately via email, and delete

it from your computer.



Any views or opinions presented are solely those of the author and do=
not

necessarily represent those of the company.



Cromwell Tools Limited, PO Box 14, 65 Chartwell Drive

Wigston, Leicester LE18 1AT. Tel 0116 2888000

Registered in England and Wales, Reg No 00986161

VAT GB 115 5713 87 900

__________________________________________________
</HTML>

------_=_NextPart_001_01CA7A67.8D61C288--
thornef [ Fr, 11 Dezember 2009 14:40 ] [ ID #2025529 ]

Re: AIX 5.3 Out of Memory Error - 64-bit

On Fri, Dec 11, 2009 at 6:40 AM, Thorne, Francis <thornef [at] cromwell.co.uk> w=
rote:
> Hi All
>
> I'm looking for some help with regards a postgres 64-bit install I=A0 set=
up
> on a IBM AIX machine.
>
> I used the following install options whien I installed postgres
>
> BINDIR =3D
> /usr/local/pgsql837-64/bin
> DOCDIR =3D
> /usr/local/pgsql837-64/doc
> INCLUDEDIR =3D
> /usr/local/pgsql837-64/include
> PKGINCLUDEDIR =3D
> /usr/local/pgsql837-64/include
> INCLUDEDIR-SERVER =3D
> /usr/local/pgsql837-64/include/server
> LIBDIR =3D
> /usr/local/pgsql837-64/lib
> PKGLIBDIR =3D
> /usr/local/pgsql837-64/lib
> LOCALEDIR
> =3D
> MANDIR =3D
> /usr/local/pgsql837-64/man
> SHAREDIR =3D
> /usr/local/pgsql837-64/share
> SYSCONFDIR =3D
> /usr/local/pgsql837-64/etc
> PGXS =3D
> /usr/local/pgsql837-64/lib/pgxs/src/makefiles/pgxs.mk
> CONFIGURE =3D '--prefix=3D/usr/local/pgsql837-64' '--with-pgport=3D5422'
> '--enable-thr
> ead-safety' '--enable-integer-datetimes' 'CC=3Dgcc -maix64'
> 'LDFLAGS=3D-Wl,-bbigtoc'
> CC =3D gcc
> -maix64
> CPPFLAGS
> =3D
> CFLAGS =3D -O2 -Wall -Wmissing-prototypes -Wpointer-arith -Winline
> -Wdeclaration-a
> fter-statement -Wendif-labels -fno-strict-aliasing
> -fwrapv
> CFLAGS_SL
> =3D
> LDFLAGS =3D -Wl,-bbigtoc
> -Wl,-blibpath:/usr/local/pgsql837-64/lib:/usr/lib:/lib
> LDFLAGS_SL =3D -Wl,-bnoentry -Wl,-H512
> -Wl,-bM:SRE
> LIBS =3D -lpgport -lz -lreadline -lld
> -lm
> VERSION =3D PostgreSQL 8.3.7
>
> And the spec of the AIX machine is a follows.
>
> AIX 5.3
> 2x Power 5 CPU's
> 6GB RAM
>
> If I run postgres with the standard postgresql.conf install then all quer=
ies
> run (albiet sometimes slower than i'd expect).=A0 However if I start to c=
hange
> some of the memory settings for example shared_buffers, temp_buffers,
> work_mem, maintenance_workmem above 128-256MB and run a large query or
> create a large indexes i get the error below
>
> Out of Memory
> Failed on request of size 167873 (this value will change)
>
> Any thoughts or ideas would be greatly appreciated

Don't set work_mem so high? shared_buffers at 256M is no big deal.
work_mem at 256M is per sort. So a dozen users each running queries
with 3 or 4 sorts could chew up 6G pretty fast.

--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Scott Marlowe [ Fr, 11 Dezember 2009 19:18 ] [ ID #2025531 ]

Re: AIX 5.3 Out of Memory Error - 64-bit

On Fri, 2009-12-11 at 11:18 -0700, Scott Marlowe wrote:
> On Fri, Dec 11, 2009 at 6:40 AM, Thorne, Francis <thornef [at] cromwell.co.uk> wrote:
> > Hi All
> >
> > I'm looking for some help with regards a postgres 64-bit install I set up
> > on a IBM AIX machine.
> >
> > I used the following install options whien I installed postgres
> >
> > BINDIR =
> > /usr/local/pgsql837-64/bin
> > DOCDIR =
> > /usr/local/pgsql837-64/doc
> > INCLUDEDIR =
> > /usr/local/pgsql837-64/include
> > PKGINCLUDEDIR =
> > /usr/local/pgsql837-64/include
> > INCLUDEDIR-SERVER =
> > /usr/local/pgsql837-64/include/server
> > LIBDIR =
> > /usr/local/pgsql837-64/lib
> > PKGLIBDIR =
> > /usr/local/pgsql837-64/lib
> > LOCALEDIR
> > =
> > MANDIR =
> > /usr/local/pgsql837-64/man
> > SHAREDIR =
> > /usr/local/pgsql837-64/share
> > SYSCONFDIR =
> > /usr/local/pgsql837-64/etc
> > PGXS =
> > /usr/local/pgsql837-64/lib/pgxs/src/makefiles/pgxs.mk
> > CONFIGURE = '--prefix=/usr/local/pgsql837-64' '--with-pgport=5422'
> > '--enable-thr
> > ead-safety' '--enable-integer-datetimes' 'CC=gcc -maix64'
> > 'LDFLAGS=-Wl,-bbigtoc'
> > CC = gcc
> > -maix64
> > CPPFLAGS
> > =
> > CFLAGS = -O2 -Wall -Wmissing-prototypes -Wpointer-arith -Winline
> > -Wdeclaration-a
> > fter-statement -Wendif-labels -fno-strict-aliasing
> > -fwrapv
> > CFLAGS_SL
> > =
> > LDFLAGS = -Wl,-bbigtoc
> > -Wl,-blibpath:/usr/local/pgsql837-64/lib:/usr/lib:/lib
> > LDFLAGS_SL = -Wl,-bnoentry -Wl,-H512
> > -Wl,-bM:SRE
> > LIBS = -lpgport -lz -lreadline -lld
> > -lm
> > VERSION = PostgreSQL 8.3.7
> >
> > And the spec of the AIX machine is a follows.
> >
> > AIX 5.3
> > 2x Power 5 CPU's
> > 6GB RAM
> >
> > If I run postgres with the standard postgresql.conf install then all queries
> > run (albiet sometimes slower than i'd expect). However if I start to change
> > some of the memory settings for example shared_buffers, temp_buffers,
> > work_mem, maintenance_workmem above 128-256MB and run a large query or
> > create a large indexes i get the error below
> >
> > Out of Memory
> > Failed on request of size 167873 (this value will change)
> >
> > Any thoughts or ideas would be greatly appreciated
>
> Don't set work_mem so high? shared_buffers at 256M is no big deal.
> work_mem at 256M is per sort. So a dozen users each running queries
> with 3 or 4 sorts could chew up 6G pretty fast.

AIX also sets a 2GB limit per process by default - security policy I
believe (not 100% sure of the exact details). I've hit this on 64bit
AIX 5.3.

--
Brad Nicholson 416-673-4106
Database Administrator, Afilias Canada Corp.



--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Brad Nicholson [ Fr, 11 Dezember 2009 20:35 ] [ ID #2025532 ]

Re: AIX 5.3 Out of Memory Error - 64-bit

Thanks for the information both of you, I'll look into your suggestions.
Do the switches I've used for the 64-bit installs look to be o.k ?

-----Original Message-----
From: Brad Nicholson [mailto:bnichols [at] ca.afilias.info]
Sent: 11 December 2009 19:35
To: Scott Marlowe
Cc: Thorne, Francis; pgsql-admin [at] postgresql.org
Subject: Re: [ADMIN] AIX 5.3 Out of Memory Error - 64-bit

On Fri, 2009-12-11 at 11:18 -0700, Scott Marlowe wrote:
> On Fri, Dec 11, 2009 at 6:40 AM, Thorne, Francis
<thornef [at] cromwell.co.uk> wrote:
> > Hi All
> >
> > I'm looking for some help with regards a postgres 64-bit install I
set up
> > on a IBM AIX machine.
> >
> > I used the following install options whien I installed postgres
> >
> > BINDIR =3D
> > /usr/local/pgsql837-64/bin
> > DOCDIR =3D
> > /usr/local/pgsql837-64/doc
> > INCLUDEDIR =3D
> > /usr/local/pgsql837-64/include
> > PKGINCLUDEDIR =3D
> > /usr/local/pgsql837-64/include
> > INCLUDEDIR-SERVER =3D
> > /usr/local/pgsql837-64/include/server
> > LIBDIR =3D
> > /usr/local/pgsql837-64/lib
> > PKGLIBDIR =3D
> > /usr/local/pgsql837-64/lib
> > LOCALEDIR
> > =3D
> > MANDIR =3D
> > /usr/local/pgsql837-64/man
> > SHAREDIR =3D
> > /usr/local/pgsql837-64/share
> > SYSCONFDIR =3D
> > /usr/local/pgsql837-64/etc
> > PGXS =3D
> > /usr/local/pgsql837-64/lib/pgxs/src/makefiles/pgxs.mk
> > CONFIGURE =3D '--prefix=3D/usr/local/pgsql837-64' '--with-pgport=3D5422'
> > '--enable-thr
> > ead-safety' '--enable-integer-datetimes' 'CC=3Dgcc -maix64'
> > 'LDFLAGS=3D-Wl,-bbigtoc'
> > CC =3D gcc
> > -maix64
> > CPPFLAGS
> > =3D
> > CFLAGS =3D -O2 -Wall -Wmissing-prototypes -Wpointer-arith -Winline
> > -Wdeclaration-a
> > fter-statement -Wendif-labels -fno-strict-aliasing
> > -fwrapv
> > CFLAGS_SL
> > =3D
> > LDFLAGS =3D -Wl,-bbigtoc
> > -Wl,-blibpath:/usr/local/pgsql837-64/lib:/usr/lib:/lib
> > LDFLAGS_SL =3D -Wl,-bnoentry -Wl,-H512
> > -Wl,-bM:SRE
> > LIBS =3D -lpgport -lz -lreadline -lld
> > -lm
> > VERSION =3D PostgreSQL 8.3.7
> >
> > And the spec of the AIX machine is a follows.
> >
> > AIX 5.3
> > 2x Power 5 CPU's
> > 6GB RAM
> >
> > If I run postgres with the standard postgresql.conf install then all
queries
> > run (albiet sometimes slower than i'd expect). However if I start
to change
> > some of the memory settings for example shared_buffers,
temp_buffers,
> > work_mem, maintenance_workmem above 128-256MB and run a large query
or
> > create a large indexes i get the error below
> >
> > Out of Memory
> > Failed on request of size 167873 (this value will change)
> >
> > Any thoughts or ideas would be greatly appreciated
>
> Don't set work_mem so high? shared_buffers at 256M is no big deal.
> work_mem at 256M is per sort. So a dozen users each running queries
> with 3 or 4 sorts could chew up 6G pretty fast.

AIX also sets a 2GB limit per process by default - security policy I
believe (not 100% sure of the exact details). I've hit this on 64bit
AIX 5.3.

--
Brad Nicholson 416-673-4106
Database Administrator, Afilias Canada Corp.



___________________________________________________

This email is intended for the named recipient. The information contained=

in it is confidential. You should not copy it for any purposes, nor
disclose its contents to any other party. If you received this email
in error, please notify the sender immediately via email, and delete it from
your computer.

Any views or opinions presented are solely those of the author and do not=

necessarily represent those of the company.

Cromwell Tools Limited, PO Box 14, 65 Chartwell Drive
Wigston, Leicester LE18 1AT. Tel 0116 2888000
Registered in England and Wales, Reg No 00986161
VAT GB 115 5713 87 900
__________________________________________________


--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
thornef [ Mo, 14 Dezember 2009 14:54 ] [ ID #2025841 ]
Datenbanken » gmane.comp.db.postgresql.admin » AIX 5.3 Out of Memory Error - 64-bit

Vorheriges Thema: Error when clustering a table
Nächstes Thema: ident authentication over tcp