out of memory

--_e372b9b8-3540-4f1a-b0d1-35043e62140f_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi

I have a dedicated database server with 16 GB of RAM.

and the oom-killer is killing my database

this is the output kernel:

postmaster invoked oom-killer: gfp_mask=3D0xd0=2C order=3D1=2C oomkilladj=
=3D0
Pid: 16667=2C comm: postmaster Tainted: G W 2.6.27.6 #7
[<c10510f9>] oom_kill_process+0x103/0x1d5
[<c11c14cc>] security_capable+0x9/0xa
[<c1050f0d>] badness+0x118/0x201
[<c10513fc>] out_of_memory+0x231/0x265
[<c1053300>] __alloc_pages_internal+0x322/0x447
[<c106ac5e>] alloc_pages_current+0x59/0x89
[<c1051c2c>] __get_free_pages+0xa/0x16
[<c101f815>] copy_process+0xa2/0xeaa
[<c1020683>] do_fork+0x66/0x2c3
[<c1001a59>] sys_clone+0x32/0x36
[<c100334a>] syscall_call+0x7/0xb
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D=3D=3D
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0=2C btch: 1 usd: 0
CPU 1: hi: 0=2C btch: 1 usd: 0
CPU 2: hi: 0=2C btch: 1 usd: 0
CPU 3: hi: 0=2C btch: 1 usd: 0
CPU 4: hi: 0=2C btch: 1 usd: 0
CPU 5: hi: 0=2C btch: 1 usd: 0
CPU 6: hi: 0=2C btch: 1 usd: 0
CPU 7: hi: 0=2C btch: 1 usd: 0
CPU 8: hi: 0=2C btch: 1 usd: 0
CPU 9: hi: 0=2C btch: 1 usd: 0
CPU 10: hi: 0=2C btch: 1 usd: 0
CPU 11: hi: 0=2C btch: 1 usd: 0
CPU 12: hi: 0=2C btch: 1 usd: 0
CPU 13: hi: 0=2C btch: 1 usd: 0
CPU 14: hi: 0=2C btch: 1 usd: 0
CPU 15: hi: 0=2C btch: 1 usd: 0
Node 0 Normal per-cpu:
CPU 0: hi: 186=2C btch: 31 usd: 0
CPU 1: hi: 186=2C btch: 31 usd: 30
CPU 2: hi: 186=2C btch: 31 usd: 0
CPU 3: hi: 186=2C btch: 31 usd: 0
CPU 4: hi: 186=2C btch: 31 usd: 0
CPU 5: hi: 186=2C btch: 31 usd: 0
CPU 6: hi: 186=2C btch: 31 usd: 26
CPU 7: hi: 186=2C btch: 31 usd: 26
CPU 8: hi: 186=2C btch: 31 usd: 0
CPU 9: hi: 186=2C btch: 31 usd: 0
CPU 10: hi: 186=2C btch: 31 usd: 0
CPU 11: hi: 186=2C btch: 31 usd: 0
CPU 12: hi: 186=2C btch: 31 usd: 0
CPU 13: hi: 186=2C btch: 31 usd: 0
CPU 14: hi: 186=2C btch: 31 usd: 0
CPU 15: hi: 186=2C btch: 31 usd: 25
Node 0 HighMem per-cpu:
CPU 0: hi: 186=2C btch: 31 usd: 0
CPU 1: hi: 186=2C btch: 31 usd: 30
CPU 2: hi: 186=2C btch: 31 usd: 0
CPU 3: hi: 186=2C btch: 31 usd: 0
CPU 4: hi: 186=2C btch: 31 usd: 0
CPU 5: hi: 186=2C btch: 31 usd: 167
CPU 6: hi: 186=2C btch: 31 usd: 25
CPU 7: hi: 186=2C btch: 31 usd: 19
CPU 8: hi: 186=2C btch: 31 usd: 0
CPU 9: hi: 186=2C btch: 31 usd: 0
CPU 10: hi: 186=2C btch: 31 usd: 0
CPU 11: hi: 186=2C btch: 31 usd: 0
CPU 12: hi: 186=2C btch: 31 usd: 0
CPU 13: hi: 186=2C btch: 31 usd: 0
CPU 14: hi: 186=2C btch: 31 usd: 0
CPU 15: hi: 186=2C btch: 31 usd: 23
Active:1573667 inactive:609150 dirty:46 writeback:107 unstable:0
free:1750894 slab:31196 mapped:538832 pagetables:143359 bounce:0
Node 0 DMA free:3540kB min:64kB low:80kB high:96kB active:0kB inactive:0kB =
prese =
nt:15836kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 873 16095 16095
Node 0 Normal free:28132kB min:3744kB low:4680kB high:5616kB active:840kB i=
nacti =
ve:892kB present:894080kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 121778 121778
Node 0 HighMem free:6971904kB min:512kB low:16836kB high:33160kB active:629=
3828k =
B inactive:2435708kB present:15587608kB pages_scanned:0 all_unreclai=
mable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 113*4kB 11*8kB 1*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1=
024kB =
1*2048kB 0*4096kB =3D 3660kB
Node 0 Normal: 6429*4kB 147*8kB 9*16kB 2*32kB 2*64kB 1*128kB 0*256kB 1*512k=
B 1*1 =
024kB 0*2048kB 0*4096kB =3D 28892kB
Node 0 HighMem: 690211*4kB 364384*8kB 72902*16kB 3650*32kB 17*64kB 50*128kB=
5*25 =
6kB 2*512kB 1*1024kB 0*2048kB 1*4096kB =3D 6974060kB
1920296 total pagecache pages
0 pages in swap cache
Swap cache stats: add 913280=2C delete 913280=2C find 207387/229468
Free swap =3D 1754452kB
Total swap =3D 3904552kB
4390911 pages RAM
4161535 pages HighMem
268987 pages reserved
6066507 pages shared
1384540 pages non-shared
Out of memory: kill process 13279 (postmaster) score 546058 or a child
Killed process 13279 (postmaster)

This is the output of free -m before and after the kill

free -m
total used free shared buffers cached
Mem: 16101 9302 6799 0 3 7521
-/+ buffers/cache: 1776 14324
Swap: 3813 2099 1713

free -m
total used free shared buffers cached
Mem: 16101 5606 10494 0 7 5410
-/+ buffers/cache: 188 15912
Swap: 3813 2099 1713

the sysctl.conf with
kernel.shmmax =3D 10737418240
vm.overcommit_memory =3D 2

I do not what why the oom-killer kill the postgres if there are available m=
emory.

I would appreciate any help

Regars...

____________________________________________________________ _____
=BFQuieres transformarte en un emotic=F3n de Messenger? Descubre c=F3mo
www.messengernews.com.mx=

--_e372b9b8-3540-4f1a-b0d1-35043e62140f_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style>
..hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 10pt=3B
font-family:Verdana
}
</style>
</head>
<body class=3D'hmmessage'>
 Hi I have a dedicated database server with 16 GB of RAM. =
and the oom-killer is killing my database this is the output kernel:=
 postmaster invoked oom-killer: gfp_mask=3D0xd0=2C order=3D1=2C oomk=
illadj=3D0 Pid: 16667=2C comm: postmaster Tainted: G =3B =3B&nbs=
p=3B =3B =3B =3B =3B W 2.6.27.6 #7 =3B[<=3Bc10510=
f9>=3B] oom_kill_process+0x103/0x1d5 =3B[<=3Bc11c14cc>=3B] se=
curity_capable+0x9/0xa =3B[<=3Bc1050f0d>=3B] badness+0x118/0x20=
1 =3B[<=3Bc10513fc>=3B] out_of_memory+0x231/0x265 =3B[&=
lt=3Bc1053300>=3B] __alloc_pages_internal+0x322/0x447 =3B[<=3Bc=
106ac5e>=3B] alloc_pages_current+0x59/0x89 =3B[<=3Bc1051c2c>=
=3B] __get_free_pages+0xa/0x16 =3B[<=3Bc101f815>=3B] copy_proce=
ss+0xa2/0xeaa =3B[<=3Bc1020683>=3B] do_fork+0x66/0x2c3 =
=3B[<=3Bc1001a59>=3B] sys_clone+0x32/0x36 =3B[<=3Bc100334a>=
=3B] syscall_call+0x7/0xb =3B=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Mem-Info: Node 0 DMA per-cpu: CP=
U =3B =3B =3B 0: hi: =3B =3B =3B 0=2C btch: =3B=
=3B 1 usd: =3B =3B 0 CPU =3B =3B =3B 1: hi:&nbs=
p=3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B =3B 0<br=
>CPU =3B =3B =3B 2: hi: =3B =3B =3B 0=2C btch: =
=3B =3B 1 usd: =3B =3B 0 CPU =3B =3B =3B 3: hi:&=
nbsp=3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B =3B 0=
 CPU =3B =3B =3B 4: hi: =3B =3B =3B 0=2C btch:&n=
bsp=3B =3B 1 usd: =3B =3B 0 CPU =3B =3B =3B 5: h=
i: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B =
=3B 0 CPU =3B =3B =3B 6: hi: =3B =3B =3B 0=2C bt=
ch: =3B =3B 1 usd: =3B =3B 0 CPU =3B =3B =3B=
7: hi: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B&n=
bsp=3B 0 CPU =3B =3B =3B 8: hi: =3B =3B =3B 0=2C=
btch: =3B =3B 1 usd: =3B =3B 0 CPU =3B =3B =
=3B 9: hi: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =
=3B =3B 0 CPU =3B =3B 10: hi: =3B =3B =3B 0=2C b=
tch: =3B =3B 1 usd: =3B =3B 0 CPU =3B =3B 11: hi=
: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B =3B=
0 CPU =3B =3B 12: hi: =3B =3B =3B 0=2C btch: =
=3B =3B 1 usd: =3B =3B 0 CPU =3B =3B 13: hi: =3B=
=3B =3B 0=2C btch: =3B =3B 1 usd: =3B =3B 0 CPU=
=3B =3B 14: hi: =3B =3B =3B 0=2C btch: =3B =3B=
1 usd: =3B =3B 0 CPU =3B =3B 15: hi: =3B =3B&nb=
sp=3B 0=2C btch: =3B =3B 1 usd: =3B =3B 0 Node 0 Normal =
per-cpu: CPU =3B =3B =3B 0: hi: =3B 186=2C btch: =3B=
31 usd: =3B =3B 0 CPU =3B =3B =3B 1: hi: =3B 18=
6=2C btch: =3B 31 usd: =3B 30 CPU =3B =3B =3B 2: hi:=
=3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =
=3B =3B 3: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0<b=
r>CPU =3B =3B =3B 4: hi: =3B 186=2C btch: =3B 31 usd:&n=
bsp=3B =3B 0 CPU =3B =3B =3B 5: hi: =3B 186=2C btch:=
=3B 31 usd: =3B =3B 0 CPU =3B =3B =3B 6: hi:&nb=
sp=3B 186=2C btch: =3B 31 usd: =3B 26 CPU =3B =3B =
=3B 7: hi: =3B 186=2C btch: =3B 31 usd: =3B 26 CPU =3B&n=
bsp=3B =3B 8: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B =
0 CPU =3B =3B =3B 9: hi: =3B 186=2C btch: =3B 31 usd=
: =3B =3B 0 CPU =3B =3B 10: hi: =3B 186=2C btch:&nbs=
p=3B 31 usd: =3B =3B 0 CPU =3B =3B 11: hi: =3B 186=
=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B 12: hi:&=
nbsp=3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =
=3B 13: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU&n=
bsp=3B =3B 14: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B=
0 CPU =3B =3B 15: hi: =3B 186=2C btch: =3B 31 usd: =
=3B 25 Node 0 HighMem per-cpu: CPU =3B =3B =3B 0: hi:&nbs=
p=3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B&=
nbsp=3B 1: hi: =3B 186=2C btch: =3B 31 usd: =3B 30 CPU =
=3B =3B =3B 2: hi: =3B 186=2C btch: =3B 31 usd: =3B&nbs=
p=3B 0 CPU =3B =3B =3B 3: hi: =3B 186=2C btch: =3B 3=
1 usd: =3B =3B 0 CPU =3B =3B =3B 4: hi: =3B 186=
=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B =3B =
5: hi: =3B 186=2C btch: =3B 31 usd: 167 CPU =3B =3B =
=3B 6: hi: =3B 186=2C btch: =3B 31 usd: =3B 25 CPU =3B&n=
bsp=3B =3B 7: hi: =3B 186=2C btch: =3B 31 usd: =3B 19 CP=
U =3B =3B =3B 8: hi: =3B 186=2C btch: =3B 31 usd: =
=3B =3B 0 CPU =3B =3B =3B 9: hi: =3B 186=2C btch:&nb=
sp=3B 31 usd: =3B =3B 0 CPU =3B =3B 10: hi: =3B 186=
=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B 11: hi:&=
nbsp=3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =
=3B 12: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU&n=
bsp=3B =3B 13: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B=
0 CPU =3B =3B 14: hi: =3B 186=2C btch: =3B 31 usd: =
=3B =3B 0 CPU =3B =3B 15: hi: =3B 186=2C btch: =3B 3=
1 usd: =3B 23 Active:1573667 inactive:609150 dirty:46 writeback:107 =
unstable:0 =3Bfree:1750894 slab:31196 mapped:538832 pagetables:1433=
59 bounce:0 Node 0 DMA free:3540kB min:64kB low:80kB high:96kB active:0k=
B inactive:0kB prese =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B nt:15836kB pages_scanned:0 all_unreclaimab=
le? no lowmem_reserve[]: 0 873 16095 16095 Node 0 Normal free:28132kB=
min:3744kB low:4680kB high:5616kB active:840kB inacti =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B ve:892kB p=
resent:894080kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: =
0 0 121778 121778 Node 0 HighMem free:6971904kB min:512kB low:16836kB hi=
gh:33160kB active:6293828k =3B =3B =3B =3B =3B =3B&=
nbsp=3B =3B =3B =3B =3B =3B =3B =3B =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B B inactive:2435708kB present:15587608=
kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 No=
de 0 DMA: 113*4kB 11*8kB 1*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*102=
4kB =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B 1*2048kB 0*4096kB =3D 3660kB Node 0 Normal: 6429*4=
kB 147*8kB 9*16kB 2*32kB 2*64kB 1*128kB 0*256kB 1*512kB 1*1 =3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B 024kB=
0*2048kB 0*4096kB =3D 28892kB Node 0 HighMem: 690211*4kB 364384*8kB 729=
02*16kB 3650*32kB 17*64kB 50*128kB 5*25 =3B =3B =3B =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B 6kB 2*512kB 1*1024kB 0*=
2048kB 1*4096kB =3D 6974060kB 1920296 total pagecache pages 0 pages i=
n swap cache Swap cache stats: add 913280=2C delete 913280=2C find 20738=
7/229468 Free swap =3B =3D 1754452kB Total swap =3D 3904552kB =
4390911 pages RAM 4161535 pages HighMem 268987 pages reserved 6066=
507 pages shared 1384540 pages non-shared Out of memory: kill process=
13279 (postmaster) score 546058 or a child Killed process 13279 (postma=
ster) This is the output of free -m before and after the kill <b=
r> free -m =3B =3B =3B =3B =3B =3B =3B&n=
bsp=3B =3B =3B =3B =3B total =3B =3B =3B =
=3B =3B =3B used =3B =3B =3B =3B =3B =3B fr=
ee =3B =3B =3B =3B shared =3B =3B =3B buffers&n=
bsp=3B =3B =3B =3B cached Mem: =3B =3B =3B =
=3B =3B =3B =3B =3B 16101 =3B =3B =3B =3B&n=
bsp=3B =3B 9302 =3B =3B =3B =3B =3B =3B 6799&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B 0&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B 3 =
=3B =3B =3B =3B =3B =3B 7521 -/+ buffers/cache: =
=3B =3B =3B =3B =3B =3B 1776 =3B =3B =3B&nb=
sp=3B =3B 14324 Swap: =3B =3B =3B =3B =3B =
=3B =3B =3B 3813 =3B =3B =3B =3B =3B =3B 20=
99 =3B =3B =3B =3B =3B =3B 1713 free -m<=
br> =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B total =3B =3B =3B =3B =3B =
=3B used =3B =3B =3B =3B =3B =3B free =3B =
=3B =3B =3B shared =3B =3B =3B buffers =3B =3B&=
nbsp=3B =3B cached Mem: =3B =3B =3B =3B =3B =
=3B =3B =3B 16101 =3B =3B =3B =3B =3B =3B 5=
606 =3B =3B =3B =3B =3B 10494 =3B =3B =3B&n=
bsp=3B =3B =3B =3B =3B =3B 0 =3B =3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B 7 =3B =3B =3B&nbs=
p=3B =3B =3B 5410 -/+ buffers/cache: =3B =3B =3B&nbs=
p=3B =3B =3B =3B 188 =3B =3B =3B =3B =3B 15=
912 Swap: =3B =3B =3B =3B =3B =3B =3 B =
=3B 3813 =3B =3B =3B =3B =3B =3B 2099 =3B =
=3B =3B =3B =3B =3B 1713 the sysctl.conf =3B=
with kernel.shmmax =3D 10737418240 vm.overcommit_memory =3D 2 <br=
>I do not what why the oom-killer kill the postgres if there are available =
memory. I would appreciate any help Regars... 
<hr />=
No olvides consultar tus correos desde <a href=3D'www.messengernews.com.mx=
' target=3D'_new'>la ventana principal de Messenger</a></body>
</html>=

--_e372b9b8-3540-4f1a-b0d1-35043e62140f_--

--0015174be2702b6ab10464f25080
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

On Thu, Mar 12, 2009 at 9:17 PM, Fabricio <fabrixio1 [at] hotmail.com> wrote:

>
> Hi
>
> I have a dedicated database server with 16 GB of RAM.
>
> and the oom-killer is killing my database
>

What kernel and architecture are you running? Show your `uname -a` please.

--
Vladimir Rusinov
http://greenmice.info/

--0015174be2702b6ab10464f25080
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

 <div class=3D"gmail_quote">On Thu, Mar 12, 2009 at 9:17 PM, Fabrici=
o <<a href=3D"mailto:fabrixio1 [at] hotmail.com">fabrixio1 [at] =
hotmail.com</a>> wrote: <blockquote class=3D"gmail_quote" styl=
e=3D"border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; =
padding-left: 1ex;">

<div>
 Hi I have a dedicated database server with 16 GB of RAM. =
and the oom-killer is killing my database</div></blockquote><div> What k=
ernel and architecture are you running? Show your `uname -a` please. 
</div></div> -- Vladimir Rusinov <a href=3D=
"http://greenmice.info/">http://greenmice.info/</a> 

--0015174be2702b6ab10464f25080--

--_a7d58399-aa62-4924-b1db-0d290f0320ef_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hello...

Linux 2.6.27.6 #7 SMP Sun Nov 16 00:48:35 MST 2008 i686 i686 i386 GNU/Linux

Slackware 11 and Postgres 8.1.15

thanks...

Date: Fri=2C 13 Mar 2009 00:03:16 +0300
Subject: Re: [ADMIN] out of memory
From: vladimir [at] greenmice.info
To: fabrixio1 [at] hotmail.com
CC: pgsql-admin [at] postgresql.org

On Thu=2C Mar 12=2C 2009 at 9:17 PM=2C Fabricio <fabrixio1 [at] hotmail.com> wro=
te:

Hi

I have a dedicated database server with 16 GB of RAM.

and the oom-killer is killing my database

What kernel and architecture are you running? Show your `uname -a` please.

--
Vladimir Rusinov
http://greenmice.info/

____________________________________________________________ _____
=BFConoces todas las novedades de Messenger?
www.messengernews.com.mx=

--_a7d58399-aa62-4924-b1db-0d290f0320ef_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style>
..hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 10pt=3B
font-family:Verdana
}
</style>
</head>
<body class=3D'hmmessage'>
=3B 
Hello... 
=3B 
Linux =3B2.6.27.6 #7 SMP Sun Nov 16 00:48:35 MST 2008 i686 i686 i386 GN=
U/Linux 
Slackware 11 and Postgres 8.1.15 
=3B 
thanks... 
<HR id=3DstopSpelling>
Date: Fri=2C 13 Mar 2009 00:03:16 +0300 Subject: Re: [ADMIN] out of memo=
ry From: vladimir [at] greenmice.info To: fabrixio1 [at] hotmail.com CC: pgs=
ql-admin [at] postgresql.org 
<DIV class=3DEC_gmail_quote>On Thu=2C Mar 12=2C 2009 at 9:17 PM=2C Fabricio=
<=3B<A href=3D"mailto:fabrixio1 [at] hotmail.com">fabrixio1 [at] h=
otmail.com</A>>=3B wrote: 
<BLOCKQUOTE class=3DEC_gmail_quote style=3D"PADDING-LEFT: 1ex">
<DIV> Hi I have a dedicated database server with 16 GB of RAM.<BR=
> and the oom-killer is killing my database</DIV></BLOCKQUOTE>
<DIV> What kernel and architecture are you running? Show your `uname -a`=
please. </DIV></DIV> -- Vladimir Rusinov =
<A href=3D"http://greenmice.info/">http://greenmice.info/</A> 
<hr =
/>Personaliza=2C comparte y comun=EDcate <a href=3D'www.messengernews.com.=
mx' target=3D'_new'>como nunca antes en Messenger</a></body>
</html>=

--_a7d58399-aa62-4924-b1db-0d290f0320ef_--

--_eacc32fa-2c63-44b0-bcf7-71d60c5fbb68_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi

there's no comments?

Fabricio

From: fabrixio1 [at] hotmail.com
To: pgsql-admin [at] postgresql.org
Subject: [ADMIN] out of memory
Date: Thu=2C 12 Mar 2009 11:17:52 -0700

Hi

I have a dedicated database server with 16 GB of RAM.
Linux 2.6.27.6 #7 SMP Sun Nov 16 00:48:35 MST 2008 i686 i686 i386 GNU/Linux

Slackware 11 and Postgres 8.1.15

and the oom-killer is killing my database

this is the output kernel:

postmaster invoked oom-killer: gfp_mask=3D0xd0=2C order=3D1=2C oomkilladj=
=3D0
Pid: 16667=2C comm: postmaster Tainted: G W 2.6.27.6 #7
[<c10510f9>] oom_kill_process+0x103/0x1d5
[<c11c14cc>] security_capable+0x9/0xa
[<c1050f0d>] badness+0x118/0x201
[<c10513fc>] out_of_memory+0x231/0x265
[<c1053300>] __alloc_pages_internal+0x322/0x447
[<c106ac5e>] alloc_pages_current+0x59/0x89
[<c1051c2c>] __get_free_pages+0xa/0x16
[<c101f815>] copy_process+0xa2/0xeaa
[<c1020683>] do_fork+0x66/0x2c3
[<c1001a59>] sys_clone+0x32/0x36
[<c100334a>] syscall_call+0x7/0xb
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D=3D=3D
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0=2C btch: 1 usd: 0
CPU 1: hi: 0=2C btch: 1 usd: 0
CPU 2: hi: 0=2C btch: 1 usd: 0
CPU 3: hi: 0=2C btch: 1 usd: 0
CPU 4: hi: 0=2C btch: 1 usd: 0
CPU 5: hi: 0=2C btch: 1 usd: 0
CPU 6: hi: 0=2C btch: 1 usd: 0
CPU 7: hi: 0=2C btch: 1 usd: 0
CPU 8: hi: 0=2C btch: 1 usd: 0
CPU 9: hi: 0=2C btch: 1 usd: 0
CPU 10: hi: 0=2C btch: 1 usd: 0
CPU 11: hi: 0=2C btch: 1 usd: 0
CPU 12: hi: 0=2C btch: 1 usd: 0
CPU 13: hi: 0=2C btch: 1 usd: 0
CPU 14: hi: 0=2C btch: 1 usd: 0
CPU 15: hi: 0=2C btch: 1 usd: 0
Node 0 Normal per-cpu:
CPU 0: hi: 186=2C btch: 31 usd: 0
CPU 1: hi: 186=2C btch: 31 usd: 30
CPU 2: hi: 186=2C btch: 31 usd: 0
CPU 3: hi: 186=2C btch: 31 usd: 0
CPU 4: hi: 186=2C btch: 31 usd: 0
CPU 5: hi: 186=2C btch: 31 usd: 0
CPU 6: hi: 186=2C btch: 31 usd: 26
CPU 7: hi: 186=2C btch: 31 usd: 26
CPU 8: hi: 186=2C btch: 31 usd: 0
CPU 9: hi: 186=2C btch: 31 usd: 0
CPU 10: hi: 186=2C btch: 31 usd: 0
CPU 11: hi: 186=2C btch: 31 usd: 0
CPU 12: hi: 186=2C btch: 31 usd: 0
CPU 13: hi: 186=2C btch: 31 usd: 0
CPU 14: hi: 186=2C btch: 31 usd: 0
CPU 15: hi: 186=2C btch: 31 usd: 25
Node 0 HighMem per-cpu:
CPU 0: hi: 186=2C btch: 31 usd: 0
CPU 1: hi: 186=2C btch: 31 usd: 30
CPU 2: hi: 186=2C btch: 31 usd: 0
CPU 3: hi: 186=2C btch: 31 usd: 0
CPU 4: hi: 186=2C btch: 31 usd: 0
CPU 5: hi: 186=2C btch: 31 usd: 167
CPU 6: hi: 186=2C btch: 31 usd: 25
CPU 7: hi: 186=2C btch: 31 usd: 19
CPU 8: hi: 186=2C btch: 31 usd: 0
CPU 9: hi: 186=2C btch: 31 usd: 0
CPU 10: hi: 186=2C btch: 31 usd: 0
CPU 11: hi: 186=2C btch: 31 usd: 0
CPU 12: hi: 186=2C btch: 31 usd: 0
CPU 13: hi: 186=2C btch: 31 usd: 0
CPU 14: hi: 186=2C btch: 31 usd: 0
CPU 15: hi: 186=2C btch: 31 usd: 23
Active:1573667 inactive:609150 dirty:46 writeback:107 unstable:0
free:1750894 slab:31196 mapped:538832 pagetables:143359 bounce:0
Node 0 DMA free:3540kB min:64kB low:80kB high:96kB active:0kB inactive:0kB =
prese =
nt:15836kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 873 16095 16095
Node 0 Normal free:28132kB min:3744kB low:4680kB high:5616kB active:840kB i=
nacti =
ve:892kB present:894080kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 121778 121778
Node 0 HighMem free:6971904kB min:512kB low:16836kB high:33160kB active:629=
3828k =
B inactive:2435708kB present:15587608kB pages_scanned:0 all_unreclai=
mable? no
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 113*4kB 11*8kB 1*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1=
024kB =
1*2048kB 0*4096kB =3D 3660kB
Node 0 Normal: 6429*4kB 147*8kB 9*16kB 2*32kB 2*64kB 1*128kB 0*256kB 1*512k=
B 1*1 =
024kB 0*2048kB 0*4096kB =3D 28892kB
Node 0 HighMem: 690211*4kB 364384*8kB 72902*16kB 3650*32kB 17*64kB 50*128kB=
5*25 =
6kB 2*512kB 1*1024kB 0*2048kB 1*4096kB =3D 6974060kB
1920296 total pagecache pages
0 pages in swap cache
Swap cache stats: add 913280=2C delete 913280=2C find 207387/229468
Free swap =3D 1754452kB
Total swap =3D 3904552kB
4390911 pages RAM
4161535 pages HighMem
268987 pages reserved
6066507 pages shared
1384540 pages non-shared
Out of memory: kill process 13279 (postmaster) score 546058 or a child
Killed process 13279 (postmaster)

This is the output of free -m before and after the kill

free -m
total used free shared buffers cached
Mem: 16101 9302 6799 0 3 7521
-/+ buffers/cache: 1776 14324
Swap: 3813 2099 1713

free -m
total used free shared buffers cached
Mem: 16101 5606 10494 0 7 5410
-/+ buffers/cache: 188 15912
Swap: 3813 2099 1713

the sysctl.conf with
kernel.shmmax =3D 10737418240
vm.overcommit_memory =3D 2

I do not what why the oom-killer kill the postgres if there are available m=
emory.

I would appreciate any help

Regars...

No olvides consultar tus correos desde la ventana principal de Messenger
____________________________________________________________ _____
=BFQu=E9 hay de nuevo con tus contactos de Messenger?
www.messengernews.com.mx=

--_eacc32fa-2c63-44b0-bcf7-71d60c5fbb68_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style>
..hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 10pt=3B
font-family:Verdana
}
</style>
</head>
<body class=3D'hmmessage'>
 Hi there's no comments? Fabricio <hr id=3D"stopSpe=
lling">From: fabrixio1 [at] hotmail.com To: pgsql-admin [at] postgresql.org Sub=
ject: [ADMIN] out of memory Date: Thu=2C 12 Mar 2009 11:17:52 -0700 <=
br>

<style>
..ExternalClass .EC_hmmessage P
{padding:0px=3B}
..ExternalClass body.EC_hmmessage
{font-size:10pt=3Bfont-family:Verdana=3B}
</style>

 Hi I have a dedicated database server with 16 GB of RAM. Linu=
x =3B2.6.27.6 #7 SMP Sun Nov 16 00:48:35 MST 2008 i686 i686 i386 GNU/Li=
nux 
Slackware 11 and Postgres 8.1.15 and the oom-killer is killing my da=
tabase this is the output kernel: postmaster invoked oom-kill=
er: gfp_mask=3D0xd0=2C order=3D1=2C oomkilladj=3D0 Pid: 16667=2C comm: p=
ostmaster Tainted: G =3B =3B =3B =3B =3B =3B =
=3B W 2.6.27.6 #7 =3B[<=3Bc10510f9>=3B] oom_kill_process+0x103/=
0x1d5 =3B[<=3Bc11c14cc>=3B] security_capable+0x9/0xa =
=3B[<=3Bc1050f0d>=3B] badness+0x118/0x201 =3B[<=3Bc10513fc>=
=3B] out_of_memory+0x231/0x265 =3B[<=3Bc1053300>=3B] __alloc_pa=
ges_internal+0x322/0x447 =3B[<=3Bc106ac5e>=3B] alloc_pages_curr=
ent+0x59/0x89 =3B[<=3Bc1051c2c>=3B] __get_free_pages+0xa/0x16<b=
r> =3B[<=3Bc101f815>=3B] copy_process+0xa2/0xeaa =3B[<=3B=
c1020683>=3B] do_fork+0x66/0x2c3 =3B[<=3Bc1001a59>=3B] sys_cl=
one+0x32/0x36 =3B[<=3Bc100334a>=3B] syscall_call+0x7/0xb &nb=
sp=3B=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= 3D=3D=3D=3D=3D<=
br>Mem-Info: Node 0 DMA per-cpu: CPU =3B =3B =3B 0: hi:&n=
bsp=3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B =3B 0<=
br>CPU =3B =3B =3B 1: hi: =3B =3B =3B 0=2C btch:&nb=
sp=3B =3B 1 usd: =3B =3B 0 CPU =3B =3B =3B 2: hi=
: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B =3B=
0 CPU =3B =3B =3B 3: hi: =3B =3B =3B 0=2C btch:=
=3B =3B 1 usd: =3B =3B 0 CPU =3B =3B =3B 4:=
hi: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B =
=3B 0 CPU =3B =3B =3B 5: hi: =3B =3B =3B 0=2C bt=
ch: =3B =3B 1 usd: =3B =3B 0 CPU =3B =3B =3B=
6: hi: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B&n=
bsp=3B 0 CPU =3B =3B =3B 7: hi: =3B =3B =3B 0=2C=
btch: =3B =3B 1 usd: =3B =3B 0 CPU =3B =3B =
=3B 8: hi: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =
=3B =3B 0 CPU =3B =3B =3B 9: hi: =3B =3B =3B=
0=2C btch: =3B =3B 1 usd: =3B =3B 0 CPU =3B =3B=
10: hi: =3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B&=
nbsp=3B 0 CPU =3B =3B 11: hi: =3B =3B =3B 0=2C btch:=
=3B =3B 1 usd: =3B =3B 0 CPU =3B =3B 12: hi:&nb=
sp=3B =3B =3B 0=2C btch: =3B =3B 1 usd: =3B =3B 0<b=
r>CPU =3B =3B 13: hi: =3B =3B =3B 0=2C btch: =3B&nb=
sp=3B 1 usd: =3B =3B 0 CPU =3B =3B 14: hi: =3B =
=3B =3B 0=2C btch: =3B =3B 1 usd: =3B =3B 0 CPU =
=3B =3B 15: hi: =3B =3B =3B 0=2C btch: =3B =3B 1 us=
d: =3B =3B 0 Node 0 Normal per-cpu: CPU =3B =3B =
=3B 0: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU&nb=
sp=3B =3B =3B 1: hi: =3B 186=2C btch: =3B 31 usd: =3B 3=
0 CPU =3B =3B =3B 2: hi: =3B 186=2C btch: =3B 31 usd=
: =3B =3B 0 CPU =3B =3B =3B 3: hi: =3B 186=2C bt=
ch: =3B 31 usd: =3B =3B 0 CPU =3B =3B =3B 4: hi:=
=3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =
=3B =3B 5: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0<b=
r>CPU =3B =3B =3B 6: hi: =3B 186=2C btch: =3B 31 usd:&n=
bsp=3B 26 CPU =3B =3B =3B 7: hi: =3B 186=2C btch: =
=3B 31 usd: =3B 26 CPU =3B =3B =3B 8: hi: =3B 186=2C=
btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B =3B 9: =
hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B&n=
bsp=3B 10: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0 CP=
U =3B =3B 11: hi: =3B 186=2C btch: =3B 31 usd: =3B =
=3B 0 CPU =3B =3B 12: hi: =3B 186=2C btch: =3B 31 usd:&n=
bsp=3B =3B 0 CPU =3B =3B 13: hi: =3B 186=2C btch: =
=3B 31 usd: =3B =3B 0 CPU =3B =3B 14: hi: =3B 186=2C=
btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B 15: hi:&nbs=
p=3B 186=2C btch: =3B 31 usd: =3B 25 Node 0 HighMem per-cpu: =
CPU =3B =3B =3B 0: hi: =3B 186=2C btch: =3B 31 usd:&nbs=
p=3B =3B 0 CPU =3B =3B =3B 1: hi: =3B 186=2C btch:&n=
bsp=3B 31 usd: =3B 30 CPU =3B =3B =3B 2: hi: =3B 186=
=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B =3B =
3: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =
=3B =3B =3B 4: hi: =3B 186=2C btch: =3B 31 usd: =3B&nbs=
p=3B 0 CPU =3B =3B =3B 5: hi: =3B 186=2C btch: =3B 3=
1 usd: 167 CPU =3B =3B =3B 6: hi: =3B 186=2C btch: =
=3B 31 usd: =3B 25 CPU =3B =3B =3B 7: hi: =3B 186=2C=
btch: =3B 31 usd: =3B 19 CPU =3B =3B =3B 8: hi:&nbs=
p=3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B&=
nbsp=3B 9: hi: =3B 186=2C btch: =3B 31 usd: =3B =3B 0 CP=
U =3B =3B 10: hi: =3B 186=2C btch: =3B 31 usd: =3B =
=3B 0 CPU =3B =3B 11: hi: =3B 186=2C btch: =3B 31 usd:&n=
bsp=3B =3B 0 CPU =3B =3B 12: hi: =3B 186=2C btch: =
=3B 31 usd: =3B =3B 0 CPU =3B =3B 13: hi: =3B 186=2C=
btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B 14: hi:&nbs=
p=3B 186=2C btch: =3B 31 usd: =3B =3B 0 CPU =3B =3B =
15: hi: =3B 186=2C btch: =3B 31 usd: =3B 23 Active:1573667 i=
nactive:609150 dirty:46 writeback:107 unstable:0 =3Bfree:1750894 sl=
ab:31196 mapped:538832 pagetables:143359 bounce:0 Node 0 DMA free:3540kB=
min:64kB low:80kB high:96kB active:0kB inactive:0kB prese =3B =3B&=
nbsp=3B =3B =3B =3B =3B =3B =3B =3B =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B nt:15=
836kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 873 1609=
5 16095 Node 0 Normal free:28132kB min:3744kB low:4680kB high:5616kB act=
ive:840kB inacti =3B =3B =3B =3B =3B =3B = 3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B ve:892kB present:894080kB pages_scanned:0 all_u=
nreclaimable? no lowmem_reserve[]: 0 0 121778 121778 Node 0 HighMem f=
ree:6971904kB min:512kB low:16836kB high:33160kB active:6293828k =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
B inactive:2435708kB present:15587608kB pages_scanned:0 all_unreclaimable?=
no lowmem_reserve[]: 0 0 0 0 Node 0 DMA: 113*4kB 11*8kB 1*16kB 1*32k=
B 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB =3B =3B =3B =3B&n=
bsp=3B =3B =3B =3B =3B =3B =3B = 3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B 1*2048kB 0*4096=
kB =3D 3660kB Node 0 Normal: 6429*4kB 147*8kB 9*16kB 2*32kB 2*64kB 1*128=
kB 0*256kB 1*512kB 1*1 =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B 024kB 0*2048kB 0*4096kB =3D 28892kB Nod=
e 0 HighMem: 690211*4kB 364384*8kB 72902*16kB 3650*32kB 17*64kB 50*128kB 5*=
25 =3B =3B =3B =3B =3B =3B =3B&n bsp=3B =3B&=
nbsp=3B =3B =3B =3B =3B =3B =3B =3B =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B 6kB 2*512kB 1*1024kB 0*2048kB 1*4096kB =3D 6974060kB 19202=
96 total pagecache pages 0 pages in swap cache Swap cache stats: add =
913280=2C delete 913280=2C find 207387/229468 Free swap =3B =3D 1754=
452kB Total swap =3D 3904552kB 4390911 pages RAM 4161535 pages Hig=
hMem 268987 pages reserved 6066507 pages shared 1384540 pages non-=
shared Out of memory: kill process 13279 (postmaster) score 546058 or a =
child Killed process 13279 (postmaster) This is the output of=
free -m before and after the kill free -m =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
total =3B =3B =3B =3B =3B =3B used =3B =3B=
=3B =3B =3B =3B free =3B =3B =3B =3B share=
d =3B =3B =3B buffers =3B =3B =3B =3B cached<br=
>Mem: =3B =3B =3B =3B =3B =3B =3 B =3B 16101=
=3B =3B =3B =3B =3B =3B 9302 =3B =3B =
=3B =3B =3B =3B 6799 =3B =3B =3B =3B =3B&nb=
sp=3B =3B =3B =3B 0 =3B =3B =3B =3B =3B&nbs=
p=3B =3B =3B =3B 3 =3B =3B =3B =3B =3B =
=3B 7521 -/+ buffers/cache: =3B =3B =3B =3B =3B =
=3B 1776 =3B =3B =3B =3B =3B 14324 Swap: =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B 3813 =3B =3B&n=
bsp=3B =3B =3B =3B 2099 =3B =3B =3B =3B =3B=
=3B 1713 free -m =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B total =3B&n=
bsp=3B =3B =3B =3B =3B used =3B =3B =3B =3B=
=3B =3B free =3B =3B =3B =3B shared =3B =
=3B =3B buffers =3B =3B =3B =3B cached Mem: =3B&=
nbsp=3B =3B =3B =3B =3B =3B =3B 16101 =3B =
=3B =3B =3B =3B =3B 5606 =3B =3B =3B =3B&nb=
sp=3B 10494 =3B =3B =3B =3B =3B =3B =3 B =3B=
=3B 0 =3B =3B =3B =3B =3B =3B =3B&nb sp=3B&=
nbsp=3B 7 =3B =3B =3B =3B =3B =3B 5410 -/+ buffe=
rs/cache: =3B =3B =3B =3B =3B =3B&nb sp=3B 188 =
=3B =3B =3B =3B =3B 15912 Swap: =3B =3B =3B&=
nbsp=3B =3B =3B =3B =3B 3813 =3B =3B =3B =
=3B =3B =3B 2099 =3B =3B =3B =3B =3B =3B 17=
13 the sysctl.conf =3B with kernel.shmmax =3D 10737418240=
 vm.overcommit_memory =3D 2 I do not what why the oom-killer kill=
the postgres if there are available memory. I would appreciate any =
help Regars... <hr>No olvides consultar tus correos desde <a=
href=3D"http://www.messengernews.com.mx">la ventana principal de Messenger=
</a>
<hr />Si eres de los que usa Messenger no solo para chatear. <a h=
ref=3D'www.messengernews.com.mx' target=3D'_new'>esto te va a interesar</a>=
</body>
</html>=

--_eacc32fa-2c63-44b0-bcf7-71d60c5fbb68_--

Fabricio wrote:
>
>
> Hi
>
> I have a dedicated database server with 16 GB of RAM.
>
> and the oom-killer is killing my database

Try disabling memory overcommit; see 17.4.3 here:
http://www.postgresql.org/docs/8.3/interactive/kernel-resour ces.html

--
Alvaro Herrera http://www.CommandPrompt.com/
The PostgreSQL Company - Command Prompt, Inc.

-
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin

--0016363b9f2462df9e04657d12da
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

On Fri, Mar 13, 2009 at 11:15 PM, Fabricio <fabrixio1 [at] hotmail.com> wrote:

>
> Hello...
>
> Linux 2.6.27.6 #7 SMP Sun Nov 16 00:48:35 MST 2008 i686 i686 i386 GNU/Linux
> Slackware 11 and Postgres 8.1.15
>

Go download 64-bit OS.

--
Vladimir Rusinov
http://greenmice.info/

--0016363b9f2462df9e04657d12da
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

 <div class=3D"gmail_quote">On Fri, Mar 13, 2009 at 11:15 PM, Fabric=
io <<a href=3D"mailto:fabrixio1 [at] hotmail.com">fabrixio1=
[at] hotmail.com</a>> wrote: <blockquote class=3D"gmail_quote" sty=
le=3D"border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex;=
padding-left: 1ex;">

<div>
=C2=A0 
Hello... 
=C2=A0 
Linux=C2=A02.6.27.6 #7 SMP Sun Nov 16 00:48:35 MST 2008 i686 i686 i386 GNU/=
Linux 
Slackware 11 and Postgres 8.1.15</div></blockquote><div> Go download=
64-bit OS. </div></div> -- Vladimir Rusinov <a href=3D"http:/=
/greenmice.info/">http://greenmice.info/</a> 

--0016363b9f2462df9e04657d12da--

--_bd46865c-0556-419a-9b74-390e9ece4d44_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Thanks for answer Alvaro

Already i have memory overcommit disabled.
I've always had with the value 2

vm.overcommit_memory =3D 2

Fabricio

> Date: Wed=2C 18 Mar 2009 20:28:02 -0400
> From: alvherre [at] commandprompt.com
> To: fabrixio1 [at] hotmail.com
> CC: pgsql-admin [at] postgresql.org
> Subject: Re: [ADMIN] out of memory
>
> Fabricio wrote:
> >
> >
> > Hi
> >
> > I have a dedicated database server with 16 GB of RAM.
> >
> > and the oom-killer is killing my database
>
> Try disabling memory overcommit=3B see 17.4.3 here:
> http://www.postgresql.org/docs/8.3/interactive/kernel-resour ces.html
>
> --
> Alvaro Herrera http://www.CommandPrompt.co=
m/
> The PostgreSQL Company - Command Prompt=2C Inc.

____________________________________________________________ _____
=BFConoces todas las novedades de Messenger?
www.messengernews.com.mx=

--_bd46865c-0556-419a-9b74-390e9ece4d44_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style>
..hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 10pt=3B
font-family:Verdana
}
</style>
</head>
<body class=3D'hmmessage'>
 Thanks for answer Alvaro =3B Already i have memory overcommi=
t disabled. I've always had with the value 2 vm.overcommit_memory=
=3D 2 Fabricio >=3B Date: Wed=2C 18 Mar 2009 20:28:02 -040=
0 >=3B From: alvherre [at] commandprompt.com >=3B To: fabrixio1 [at] hotmai=
l.com >=3B CC: pgsql-admin [at] postgresql.org >=3B Subject: Re: [ADMI=
N] out of memory >=3B >=3B Fabricio wrote: >=3B >=3B =
>=3B >=3B >=3B >=3B Hi >=3B >=3B >=3B >=3B I hav=
e a dedicated database server with 16 GB of RAM. >=3B >=3B >=
=3B >=3B and the oom-killer is killing my database >=3B >=3B T=
ry disabling memory overcommit=3B see 17.4.3 here: >=3B http://www.pos=
tgresql.org/docs/8.3/interactive/kernel-resources.html >=3B >=3B=
-- >=3B Alvaro Herrera http://www.Com=
mandPrompt.com/ >=3B The PostgreSQL Company - Command Prompt=2C Inc.<b=
r>
<hr />Personaliza=2C comparte y comun=EDcate <a href=3D'www.messen=
gernews.com.mx' target=3D'_new'>como nunca antes en Messenger</a></body>
</html>=

--_bd46865c-0556-419a-9b74-390e9ece4d44_--

--_9389b2ea-a5c3-4274-aa32-1cabfff8ca07_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi

Some one know why this is happening?

I change the OS to 64 bits and now the oom-killer not hapend but Postgres i=
s still showing out of memory

Linux SERVER 2.6.18-92.el5 #1 SMP Tue Apr 29 13:16:15 EDT 2008 x86_64 x86_6=
4 x86_64 GNU/Linux
Red Hat Enterprise Linux Server release 5.2 (Tikanga)
PostgreSQL 8.1.15
32GB RAM

My postgresql.conf:
# - Memory -

shared_buffers =3D 1048576 # min 16 or max_connectio=
ns*2=2C 8KB each
temp_buffers =3D 1024 # min 100=2C 8KB each
max_prepared_transactions =3D 20 # can be 0 or more
# note: increasing max_prepared_transactions costs ~600 bytes of shared mem=
ory
# per transaction slot=2C plus lock space (see max_locks_per_transaction).
work_mem =3D 1024 # min 64=2C size in KB
maintenance_work_mem =3D 65536 # min 1024=2C size in KB
max_stack_depth =3D 2048 # min 100=2C size in KB

kernel messages:
Jul 31 11:50:08 SERVER kernel: postmaster[7686]: segfault at 00007fff3feb1b=
b0 rip 00002b2f7e17e1a8 rsp 00007fff3feb1b90 error 6
Jul 31 15:41:55 SERVER kernel: postmaster[4737]: segfault at 00007fff3feb1b=
b0 rip 00002b2f7e1851a8 rsp 00007fff3feb1b90 error 6

PostgreSQL log:
<2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for con=
nection: Cannot allocate memory
<2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for con=
nection: Cannot allocate memory
<2009-07-31 15:41:55 MDT 10.27.41.74(2606) aforeglobal sysaforeglobal 7423 =
startup> FATAL: out of memory
<2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for con=
nection: Cannot allocate memory
<2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for con=
nection: Cannot allocate memory
<2009-07-31 15:41:55 MDT 10.27.36.219(3859) db user 7424 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.20.216.82(1966) db user 7431 startup> FATAL: o=
ut of memory
TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 chunks)=3B 15906=
4 used
MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used
LockTable (locallock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=
=3B 4448 used
Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used
ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used
<2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup> DETAIL: =
Failed on request of size 24000.
TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 chunks)=3B 15906=
4 used
MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used
LockTable (locallock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=
=3B 4448 used
Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used
ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used
<2009-07-31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup> DETAIL: =
Failed on request of size 24000.
TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 chunks)=3B 15906=
4 used
MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used
LockTable (locallock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=
=3B 4448 used
Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used
ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used
<2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 startup> DETAIL: =
Failed on request of size 24000.
<2009-07-31 15:41:55 MDT 10.33.128.38(4461) db user 7438 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4462) db user 7439 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4463) db user 7440 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.20.219.194(3594) db user 7433 startup> FATAL: =
out of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4464) db user 7441 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4465) db user 7442 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.31(1263) db user 7447 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.44.5.43(3498) db user 7450 startup> FATAL: out=
of memory
<2009-07-31 15:41:55 MDT 10.27.36.219(3860) db user 7448 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.10(35976) db user 7460 idle> LOG: unexp=
ected EOF on client connection
<2009-07-31 15:41:55 MDT 7253 > LOG: server process (PID 4737) was term=
inated by signal 11
<2009-07-31 15:41:55 MDT 7253 > LOG: terminating any other active serve=
r processes
<2009-07-31
15:41:55 MDT 10.33.128.10(35976) db user 7460 idle> WARNING:
terminating connection because of crash of another server process

Before crash:

date & free -m
Fri Jul 31 15:40:01 MDT 2009
15:40:01 up 4:48=2C 3 users=2C load average: 2.64=2C 3.04=2C 3.58

total used free shared buffers cached
Mem: 32187 22292 9895 0 164 19824
-/+ buffers/cache: 2303 29884
Swap: 1983 0 1983

After crash:

date & free -m
Fri Jul 31 15:45:01 MDT 2009
15:45:01 up 4:53=2C 3 users=2C load average: 4.45=2C 3.99=2C 3.80

total used free shared buffers cached
Mem: 32187 14726 17460 0 165 13850
-/+ buffers/cache: 710 31477
Swap: 1983 0 1983

thanks in advance
greetings

From: fabrixio1 [at] hotmail.com
To: alvherre [at] commandprompt.com
CC: pgsql-admin [at] postgresql.org
Subject: Re: [ADMIN] out of memory
Date: Fri=2C 20 Mar 2009 09:15:05 -0700

Thanks for answer Alvaro

Already i have memory overcommit disabled.
I've always had with the value 2

vm.overcommit_memory =3D 2

Fabricio

> Date: Wed=2C 18 Mar 2009 20:28:02 -0400
> From: alvherre [at] commandprompt.com
> To: fabrixio1 [at] hotmail.com
> CC: pgsql-admin [at] postgresql.org
> Subject: Re: [ADMIN] out of memory
>
> Fabricio wrote:
> >
> >
> > Hi
> >
> > I have a dedicated database server with 16 GB of RAM.
> >
> > and the oom-killer is killing my database
>
> Try disabling memory overcommit=3B see 17.4.3 here:
> http://www.postgresql.org/docs/8.3/interactive/kernel-resour ces.html
>
> --
> Alvaro Herrera http://www.CommandPrompt.co=
m/
> The PostgreSQL Company - Command Prompt=2C Inc.

Date: Thu=2C 19 Mar 2009 21:36:00 +0300
Subject: Re: [ADMIN] out of memory
From: vladimir [at] greenmice.info
To: fabrixio1 [at] hotmail.com
CC: pgsql-admin [at] postgresql.org

On Fri=2C Mar 13=2C 2009 at 11:15 PM=2C Fabricio <fabrixio1 [at] hotmail.com> wr=
ote:

Hello...

Linux 2.6.27.6 #7 SMP Sun Nov 16 00:48:35 MST 2008 i686 i686 i386 GNU/Linux

Slackware 11 and Postgres 8.1.15

Go download 64-bit OS.

--
Vladimir Rusinov
http://greenmice.info/

____________________________________________________________ _____
Messenger cumple 10 a=F1os y tiene regalos para ti
www.aniversariomessenger.com.mx=

--_9389b2ea-a5c3-4274-aa32-1cabfff8ca07_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style>
..hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 10pt=3B
font-family:Verdana
}
</style>
</head>
<body class=3D'hmmessage'>
 Hi Some one know why this is happening? I change the=
OS to 64 bits and now the oom-killer not hapend but Postgres is still show=
ing out of memory Linux SERVER 2.6.18-92.el5 #1 SMP Tue Apr 29 13:16=
:15 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux Red Hat Enterprise Linux Ser=
ver release 5.2 (Tikanga) PostgreSQL 8.1.15 32GB RAM My postgr=
esql.conf: # - Memory - shared_buffers =3D 1048576 =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B # min 16 or max_connections*2=2C 8KB each temp_buf=
fers =3D 1024 =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B # min 100=2C 8KB each max_prepared_transactions=
=3D 20 =3B =3B =3B =3B =3B =3B =3B&n bsp=3B # c=
an be 0 or more # note: increasing max_prepared_transactions costs ~600 =
bytes of shared memory # per transaction slot=2C plus lock space (see ma=
x_locks_per_transaction). work_mem =3D 1024 =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B # min 64=2C size in KB maintenance_work_mem =3D=
65536 =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B # min 1024=2C size in KB max_stack_depth =3D 2048&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B # min 100=2C si=
ze in KB kernel messages: Jul 31 11:50:08 SERVER kernel: =
postmaster[7686]: segfault at 00007fff3feb1bb0 rip 00002b2f7e17e1a8 rsp 000=
07fff3feb1b90 error 6 Jul 31 15:41:55 SERVER kernel: postmaster[4737]: s=
egfault at 00007fff3feb1bb0 rip 00002b2f7e1851a8 rsp 00007fff3feb1b90 error=
6 PostgreSQL log: <=3B2009-07-31 15:41:55 MDT =3B =3B&=
nbsp=3B 7253 >=3B LOG: =3B could not fork new process for connection:=
Cannot allocate memory <=3B2009-07-31 15:41:55 MDT =3B =3B&nb=
sp=3B 7253 >=3B LOG: =3B could not fork new process for connection: C=
annot allocate memory <=3B2009-07-31 15:41:55 MDT 10.27.41.74(2606) af=
oreglobal sysaforeglobal 7423 startup>=3B FATAL: =3B out of memory<br=
><=3B2009-07-31 15:41:55 MDT =3B =3B =3B 7253 >=3B LOG:&nbs=
p=3B could not fork new process for connection: Cannot allocate memory &=
lt=3B2009-07-31 15:41:55 MDT =3B =3B =3B 7253 >=3B LOG: =
=3B could not fork new process for connection: Cannot allocate memory &l=
t=3B2009-07-31 15:41:55 MDT 10.27.36.219(3859) db user 7424 startup>=3B F=
ATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.20.216.82(1=
966) db user 7431 startup>=3B FATAL: =3B out of memory TopMemoryCo=
ntext: 164432 total in 6 blocks=3B 5368 free (1 chunks)=3B 159064 used M=
dSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used LockTable (loc=
allock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=3B 4448 used<b=
r>Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used<=
br>ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used<=
br><=3B2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup>=
=3B FATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.33.128=
..38(4458) db user 7434 startup>=3B DETAIL: =3B Failed on request of s=
ize 24000. TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 ch=
unks)=3B 159064 used MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B=
0 used LockTable (locallock hash): 8192 total in 1 blocks=3B 3744 free =
(0 chunks)=3B 4448 used Timezones: 52560 total in 2 blocks=3B 3744 free =
(0 chunks)=3B 48816 used ErrorContext: 8192 total in 1 blocks=3B 8160 fr=
ee (4 chunks)=3B 32 used <=3B2009-07-31 15:41:55 MDT 10.33.128.38(4459=
) db user 7435 startup>=3B FATAL: =3B out of memory <=3B2009-07-=
31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup>=3B DETAIL: =
=3B Failed on request of size 24000. TopMemoryContext: 164432 total in 6=
blocks=3B 5368 free (1 chunks)=3B 159064 used MdSmgr: 0 total in 0 bloc=
ks=3B 0 free (0 chunks)=3B 0 used LockTable (locallock hash): 8192 total=
in 1 blocks=3B 3744 free (0 chunks)=3B 4448 used Timezones: 52560 total=
in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used ErrorContext: 8192 to=
tal in 1 blocks=3B 8160 free (4 chunks)=3B 32 used <=3B2009-07-31 15:4=
1:55 MDT 10.33.128.38(4460) db user 7436 startup>=3B FATAL: =3B out o=
f memory <=3B2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 s=
tartup>=3B DETAIL: =3B Failed on request of size 24000. <=3B2009=
-07-31 15:41:55 MDT 10.33.128.38(4461) db user 7438 startup>=3B FATAL:&nb=
sp=3B out of memory <=3B2009-07-31 15:41:55 MDT 10.33.128.38(4462) db =
user 7439 startup>=3B FATAL: =3B out of memory <=3B2009-07-31 15=
:41:55 MDT 10.33.128.38(4463) db user 7440 startup>=3B FATAL: =3B out=
of memory <=3B2009-07-31 15:41:55 MDT 10.20.219.194(3594) db user 743=
3 startup>=3B FATAL: =3B out of memory <=3B2009-07-31 15:41:55 M=
DT 10.33.128.38(4464) db user 7441 startup>=3B FATAL: =3B out of memo=
ry <=3B2009-07-31 15:41:55 MDT 10.33.128.38(4465) db user 7442 startup=
>=3B FATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.33.=
128.31(1263) db user 7447 startup>=3B FATAL: =3B out of memory <=
=3B2009-07-31 15:41:55 MDT 10.44.5.43(3498) db user 7450 startup>=3B FATA=
L: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.27.36.219(3860=
) db user 7448 startup>=3B FATAL: =3B out of memory <=3B2009-07-=
31 15:41:55 MDT 10.33.128.10(35976) db user 7460 idle>=3B LOG: =3B un=
expected EOF on client connection <=3B2009-07-31 15:41:55 MDT =3B&=
nbsp=3B =3B 7253 >=3B LOG: =3B server process (PID 4737) was term=
inated by signal 11 <=3B2009-07-31 15:41:55 MDT =3B =3B =
=3B 7253 >=3B LOG: =3B terminating any other active server processes<=
br><=3B2009-07-31
15:41:55 MDT 10.33.128.10(35976) db user 7460 idle>=3B WARNING: =3B
terminating connection because of crash of another server process <b=
r>Before crash: date &=3B free -m Fri Jul 31 15:40:01 MDT 200=
9 =3B15:40:01 up =3B 4:48=2C =3B 3 users=2C =3B load av=
erage: 2.64=2C 3.04=2C 3.58 =3B =3B =3B =3B =3B=
=3B =3B =3B =3B =3B =3B =3B total =3B =
=3B =3B =3B =3B =3B used =3B =3B =3B =3B&nb=
sp=3B =3B free =3B =3B =3B =3B shared =3B =3B&n=
bsp=3B buffers =3B =3B =3B =3B cached Mem: =3B =
=3B =3B =3B =3B =3B =3B =3B 32187 =3B =3B&n=
bsp=3B =3B =3B 22292 =3B =3B =3B =3B =3B =
=3B 9895 =3B =3B =3B =3B =3B =3B =3B =3B&nb=
sp=3B 0 =3B =3B =3B =3B =3B =3B =3B 164 =3B=
=3B =3B =3B =3B 19824 -/+ buffers/cache: =3B =
=3B =3B =3B =3B =3B 2303 =3B =3B =3B =3B&nb=
sp=3B 29884 Swap: =3B =3B =3B =3B =3B =3B =
=3B =3B 1983 =3B =3B =3B =3B =3B =3B =3B &nb=
sp=3B =3B 0 =3B =3B =3B =3B =3B =3B 1983 <br=
>After crash: date &=3B free -m Fri Jul 31 15:45:01 MDT 2009<b=
r> =3B15:45:01 up =3B 4:53=2C =3B 3 users=2C =3B load avera=
ge: 4.45=2C 3.99=2C 3.80 =3B =3B =3B =3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B total =3B =3B=
=3B =3B =3B =3B used =3B =3B =3B =3B =
=3B =3B free =3B =3B =3B =3B shared =3B =3B&nbs=
p=3B buffers =3B =3B =3B =3B cached Mem: =3B =3B=
=3B =3B =3B =3B =3B =3B 32187 =3B =3B =
=3B =3B =3B 14726 =3B =3B =3B =3B =3B 17460&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B 0 =
=3B =3B =3B =3B =3B =3B =3B 165 =3B =3B&nbs=
p=3B =3B =3B 13850 -/+ buffers/cache: =3B =3B =3B&nb=
sp=3B =3B =3B =3B 710 =3B =3B =3B =3B =3B 3=
1477 Swap: =3B =3B =3B =3B =3B =3B =3 B =
=3B 1983 =3B =3B =3B =3B =3B =3B =3B =3B&nb=
sp=3B 0 =3B =3B =3B =3B =3B =3B 1983 thanks =
in advance greetings <hr id=3D"sto=
pSpelling">From: fabrixio1 [at] hotmail.com To: alvherre [at] commandprompt.com<br=
>CC: pgsql-admin [at] postgresql.org Subject: Re: [ADMIN] out of memory Da=
te: Fri=2C 20 Mar 2009 09:15:05 -0700 

<style>
..ExternalClass .EC_hmmessage P
{padding:0px=3B}
..ExternalClass body.EC_hmmessage
{font-size:10pt=3Bfont-family:Verdana=3B}
</style>

 Thanks for answer Alvaro =3B Already i have memory overcommi=
t disabled. I've always had with the value 2 vm.overcommit_memory=
=3D 2 Fabricio >=3B Date: Wed=2C 18 Mar 2009 20:28:02 -040=
0 >=3B From: alvherre [at] commandprompt.com >=3B To: fabrixio1 [at] hotmai=
l.com >=3B CC: pgsql-admin [at] postgresql.org >=3B Subject: Re: [ADMI=
N] out of memory >=3B >=3B Fabricio wrote: >=3B >=3B =
>=3B >=3B >=3B >=3B Hi >=3B >=3B >=3B >=3B I hav=
e a dedicated database server with 16 GB of RAM. >=3B >=3B >=
=3B >=3B and the oom-killer is killing my database >=3B >=3B T=
ry disabling memory overcommit=3B see 17.4.3 here: >=3B http://www.pos=
tgresql.org/docs/8.3/interactive/kernel-resources.html >=3B >=3B=
-- >=3B Alvaro Herrera http://www.Com=
mandPrompt.com/ >=3B The PostgreSQL Company - Command Prompt=2C Inc.<b=
r> <hr id=3D"stopSpelling">Date: Thu=2C 19 Mar 2009 21:36:00 +0300<b=
r>Subject: Re: [ADMIN] out of memory From: vladimir [at] greenmice.info To=
: fabrixio1 [at] hotmail.com CC: pgsql-admin [at] postgresql.org <d=
iv class=3D"EC_gmail_quote">On Fri=2C Mar 13=2C 2009 at 11:15 PM=2C Fabrici=
o <=3B<a href=3D"mailto:fabrixio1 [at] hotmail.com">fabrixio=
1 [at] hotmail.com</a>>=3B wrote: <blockquote class=3D"EC_gmail_quot=
e" style=3D"padding-left: 1ex=3B">

<div>
=3B 
Hello... 
=3B 
Linux =3B2.6.27.6 #7 SMP Sun Nov 16 00:48:35 MST 2008 i686 i686 i386 GN=
U/Linux 
Slackware 11 and Postgres 8.1.15</div></blockquote><div> Go download=
64-bit OS. </div></div> -- Vladimir Rusinov <a href=3D"http:/=
/greenmice.info/">http://greenmice.info/</a> 
<hr />Messenger cumpl=
e 10 a=F1os <a href=3D'www.aniversariomessenger.com.mx' target=3D'_new'>de=
ser parte de tu vida</a></body>
</html>=

--_9389b2ea-a5c3-4274-aa32-1cabfff8ca07_--

--0016364166e98da3e5047010350f
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

On Sat, Aug 1, 2009 at 1:20 AM, Fabricio <fabrixio1 [at] hotmail.com> wrote:

>
>
> Hi
>
> Some one know why this is happening?
>
> I change the OS to 64 bits and now the oom-killer not hapend but Postgres
> is still showing out of memory
>
> Linux SERVER 2.6.18-92.el5 #1 SMP Tue Apr 29 13:16:15 EDT 2008 x86_64
> x86_64 x86_64 GNU/Linux
> Red Hat Enterprise Linux Server release 5.2 (Tikanga)
> PostgreSQL 8.1.15
> 32GB RAM
>
> My postgresql.conf:
> # - Memory -
>
> shared_buffers = 1048576 # min 16 or
> max_connections*2, 8KB each
> temp_buffers = 1024 # min 100, 8KB each
> max_prepared_transactions = 20 # can be 0 or more
> # note: increasing max_prepared_transactions costs ~600 bytes of shared
> memory
> # per transaction slot, plus lock space (see max_locks_per_transaction).
> work_mem = 1024 # min 64, size in KB
> maintenance_work_mem = 65536 # min 1024, size in KB
> max_stack_depth = 2048 # min 100, size in KB
>
>
>
> kernel messages:
> Jul 31 11:50:08 SERVER kernel: postmaster[7686]: segfault at
> 00007fff3feb1bb0 rip 00002b2f7e17e1a8 rsp 00007fff3feb1b90 error 6
> Jul 31 15:41:55 SERVER kernel: postmaster[4737]: segfault at
> 00007fff3feb1bb0 rip 00002b2f7e1851a8 rsp 00007fff3feb1b90 error 6
>
> PostgreSQL log:
> <2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for
> connection: Cannot allocate memory
> <2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for
> connection: Cannot allocate memory
> <2009-07-31 15:41:55 MDT 10.27.41.74(2606) aforeglobal sysaforeglobal 7423
> startup> FATAL: out of memory
> <2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for
> connection: Cannot allocate memory
> <2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for
> connection: Cannot allocate memory
> <2009-07-31 15:41:55 MDT 10.27.36.219(3859) db user 7424 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.20.216.82(1966) db user 7431 startup> FATAL:
> out of memory
> TopMemoryContext: 164432 total in 6 blocks; 5368 free (1 chunks); 159064
> used
> MdSmgr: 0 total in 0 blocks; 0 free (0 chunks); 0 used
> LockTable (locallock hash): 8192 total in 1 blocks; 3744 free (0 chunks);
> 4448 used
> Timezones: 52560 total in 2 blocks; 3744 free (0 chunks); 48816 used
> ErrorContext: 8192 total in 1 blocks; 8160 free (4 chunks); 32 used
> <2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup> DETAIL:
> Failed on request of size 24000.
> TopMemoryContext: 164432 total in 6 blocks; 5368 free (1 chunks); 159064
> used
> MdSmgr: 0 total in 0 blocks; 0 free (0 chunks); 0 used
> LockTable (locallock hash): 8192 total in 1 blocks; 3744 free (0 chunks);
> 4448 used
> Timezones: 52560 total in 2 blocks; 3744 free (0 chunks); 48816 used
> ErrorContext: 8192 total in 1 blocks; 8160 free (4 chunks); 32 used
> <2009-07-31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup> DETAIL:
> Failed on request of size 24000.
> TopMemoryContext: 164432 total in 6 blocks; 5368 free (1 chunks); 159064
> used
> MdSmgr: 0 total in 0 blocks; 0 free (0 chunks); 0 used
> LockTable (locallock hash): 8192 total in 1 blocks; 3744 free (0 chunks);
> 4448 used
> Timezones: 52560 total in 2 blocks; 3744 free (0 chunks); 48816 used
> ErrorContext: 8192 total in 1 blocks; 8160 free (4 chunks); 32 used
> <2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 startup> DETAIL:
> Failed on request of size 24000.
> <2009-07-31 15:41:55 MDT 10.33.128.38(4461) db user 7438 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.38(4462) db user 7439 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.38(4463) db user 7440 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.20.219.194(3594) db user 7433 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.38(4464) db user 7441 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.38(4465) db user 7442 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.31(1263) db user 7447 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.44.5.43(3498) db user 7450 startup> FATAL: out
> of memory
> <2009-07-31 15:41:55 MDT 10.27.36.219(3860) db user 7448 startup> FATAL:
> out of memory
> <2009-07-31 15:41:55 MDT 10.33.128.10(35976) db user 7460 idle> LOG:
> unexpected EOF on client connection
> <2009-07-31 15:41:55 MDT 7253 > LOG: server process (PID 4737) was
> terminated by signal 11
> <2009-07-31 15:41:55 MDT 7253 > LOG: terminating any other active
> server processes
> <2009-07-31 15:41:55 MDT 10.33.128.10(35976) db user 7460 idle> WARNING:
> terminating connection because of crash of another server process
>
>
> Before crash:
>
> date & free -m
> Fri Jul 31 15:40:01 MDT 2009
> 15:40:01 up 4:48, 3 users, load average: 2.64, 3.04, 3.58
>
> total used free shared buffers cached
> Mem: 32187 22292 9895 0 164 19824
> -/+ buffers/cache: 2303 29884
> Swap: 1983 0 1983
>
> After crash:
>
> date & free -m
> Fri Jul 31 15:45:01 MDT 2009
> 15:45:01 up 4:53, 3 users, load average: 4.45, 3.99, 3.80
>
> total used free shared buffers cached
> Mem: 32187 14726 17460 0 165 13850
> -/+ buffers/cache: 710 31477
> Swap: 1983 0 1983
>

Hm, It looks weird.
BTW, I assume that 24000 in "DETAIL: Failed on request of size 24000" is
size in bytes, but may be it's size in kilobytes? o_O

How many connections (active and max) do you have?
Are you sure that nothing else could eat memory (e.g. some poorly-written
cronjob?)
How many VIRT memory does postmaster have before the crash?

Here is some suggersions:
Check memory limits in /etc/security/limits.conf and in `ulimit -a`.
tail /var/log/audit/audit.log (it might be something interesting there
especially if you are running selinux)
Try to upgrade to 8.1.17 (it should be safe and fast operation).
Check your kernerl's shm settings.
Check fsm settings.

HTH

--
Vladimir Rusinov
http://greenmice.info/

--0016364166e98da3e5047010350f
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

 <div class=3D"gmail_quote">On Sat, Aug 1, 2009 at 1:20 AM, Fabricio=
<<a href=3D"mailto:fabrixio1 [at] hotmail.com">fabrixio1 [at] h=
otmail.com</a>> wrote: <blockquote class=3D"gmail_quote" style=
=3D"border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; p=
adding-left: 1ex;">

<div>
 Hi Some one know why this is happening? I change the=
OS to 64 bits and now the oom-killer not hapend but Postgres is still show=
ing out of memory Linux SERVER 2.6.18-92.el5 #1 SMP Tue Apr 29 13:16=
:15 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux 
Red Hat Enterprise Linux Server release 5.2 (Tikanga) PostgreSQL 8.1.15<=
br>32GB RAM My postgresql.conf: # - Memory - shared_buffer=
s =3D 1048576=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A 0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=
=A0 # min 16 or max_connections*2, 8KB each 
temp_buffers =3D 1024=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =C2=A0 # min 10=
0, 8KB each max_prepared_transactions =3D 20=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0 # can be 0 or more # note: increasing max_prepared=
_transactions costs ~600 bytes of shared memory # per transaction slot, =
plus lock space (see max_locks_per_transaction). 
work_mem =3D 1024=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C 2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 # min 64, size in KB maintenance=
_work_mem =3D 65536=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0 # min 1024, size in KB max_stack_depth =3D 2048=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0 # min 100, size in KB kernel messages: Ju=
l 31 11:50:08 SERVER kernel: postmaster[7686]: segfault at 00007fff3feb1bb0=
rip 00002b2f7e17e1a8 rsp 00007fff3feb1b90 error 6 
Jul 31 15:41:55 SERVER kernel: postmaster[4737]: segfault at 00007fff3feb1b=
b0 rip 00002b2f7e1851a8 rsp 00007fff3feb1b90 error 6 PostgreSQL log:=
 <2009-07-31 15:41:55 MDT=C2=A0=C2=A0=C2=A0 7253 > LOG:=C2=A0 coul=
d not fork new process for connection: Cannot allocate memory 
<2009-07-31 15:41:55 MDT=C2=A0=C2=A0=C2=A0 7253 > LOG:=C2=A0 could no=
t fork new process for connection: Cannot allocate memory <2009-07-31=
15:41:55 MDT 10.27.41.74(2606) aforeglobal sysaforeglobal 7423 startup>=
FATAL:=C2=A0 out of memory 
<2009-07-31 15:41:55 MDT=C2=A0=C2=A0=C2=A0 7253 > LOG:=C2=A0 could no=
t fork new process for connection: Cannot allocate memory <2009-07-31=
15:41:55 MDT=C2=A0=C2=A0=C2=A0 7253 > LOG:=C2=A0 could not fork new pro=
cess for connection: Cannot allocate memory 
<2009-07-31 15:41:55 MDT 10.27.36.219(3859) db user 7424 startup> FAT=
AL:=C2=A0 out of memory <2009-07-31 15:41:55 MDT 10.20.216.82(1966) d=
b user 7431 startup> FATAL:=C2=A0 out of memory TopMemoryContext: 164=
432 total in 6 blocks; 5368 free (1 chunks); 159064 used 
MdSmgr: 0 total in 0 blocks; 0 free (0 chunks); 0 used LockTable (locall=
ock hash): 8192 total in 1 blocks; 3744 free (0 chunks); 4448 used Timez=
ones: 52560 total in 2 blocks; 3744 free (0 chunks); 48816 used ErrorCon=
text: 8192 total in 1 blocks; 8160 free (4 chunks); 32 used 
<2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup> FAT=
AL:=C2=A0 out of memory <2009-07-31 15:41:55 MDT 10.33.128.38(4458) d=
b user 7434 startup> DETAIL:=C2=A0 Failed on request of size 24000. T=
opMemoryContext: 164432 total in 6 blocks; 5368 free (1 chunks); 159064 use=
d 
MdSmgr: 0 total in 0 blocks; 0 free (0 chunks); 0 used LockTable (locall=
ock hash): 8192 total in 1 blocks; 3744 free (0 chunks); 4448 used Timez=
ones: 52560 total in 2 blocks; 3744 free (0 chunks); 48816 used ErrorCon=
text: 8192 total in 1 blocks; 8160 free (4 chunks); 32 used 
<2009-07-31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup> FAT=
AL:=C2=A0 out of memory <2009-07-31 15:41:55 MDT 10.33.128.38(4459) d=
b user 7435 startup> DETAIL:=C2=A0 Failed on request of size 24000. T=
opMemoryContext: 164432 total in 6 blocks; 5368 free (1 chunks); 159064 use=
d 
MdSmgr: 0 total in 0 blocks; 0 free (0 chunks); 0 used LockTable (locall=
ock hash): 8192 total in 1 blocks; 3744 free (0 chunks); 4448 used Timez=
ones: 52560 total in 2 blocks; 3744 free (0 chunks); 48816 used ErrorCon=
text: 8192 total in 1 blocks; 8160 free (4 chunks); 32 used 
<2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 startup> FAT=
AL:=C2=A0 out of memory <2009-07-31 15:41:55 MDT 10.33.128.38(4460) d=
b user 7436 startup> DETAIL:=C2=A0 Failed on request of size 24000. &=
lt;2009-07-31 15:41:55 MDT 10.33.128.38(4461) db user 7438 startup> FATA=
L:=C2=A0 out of memory 
<2009-07-31 15:41:55 MDT 10.33.128.38(4462) db user 7439 startup> FAT=
AL:=C2=A0 out of memory <2009-07-31 15:41:55 MDT 10.33.128.38(4463) d=
b user 7440 startup> FATAL:=C2=A0 out of memory <2009-07-31 15:41:=
55 MDT 10.20.219.194(3594) db user 7433 startup> FATAL:=C2=A0 out of mem=
ory 
<2009-07-31 15:41:55 MDT 10.33.128.38(4464) db user 7441 startup> FAT=
AL:=C2=A0 out of memory <2009-07-31 15:41:55 MDT 10.33.128.38(4465) d=
b user 7442 startup> FATAL:=C2=A0 out of memory <2009-07-31 15:41:=
55 MDT 10.33.128.31(1263) db user 7447 startup> FATAL:=C2=A0 out of memo=
ry 
<2009-07-31 15:41:55 MDT 10.44.5.43(3498) db user 7450 startup> FATAL=
:=C2=A0 out of memory <2009-07-31 15:41:55 MDT 10.27.36.219(3860) db =
user 7448 startup> FATAL:=C2=A0 out of memory <2009-07-31 15:41:55=
MDT 10.33.128.10(35976) db user 7460 idle> LOG:=C2=A0 unexpected EOF on=
client connection 
<2009-07-31 15:41:55 MDT=C2=A0=C2=A0=C2=A0 7253 > LOG:=C2=A0 server p=
rocess (PID 4737) was terminated by signal 11 <2009-07-31 15:41:55 MD=
T=C2=A0=C2=A0=C2=A0 7253 > LOG:=C2=A0 terminating any other active serve=
r processes <2009-07-31
15:41:55 MDT 10.33.128.10(35976) db user 7460 idle> WARNING:=C2=A0
terminating connection because of crash of another server process <b=
r>Before crash: date & free -m Fri Jul 31 15:40:01 MDT 2009<=
br>=C2=A015:40:01 up=C2=A0 4:48,=C2=A0 3 users,=C2=A0 load average: 2.64, 3=
..04, 3.58 
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0 to=
tal=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 used=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0 free=C2=A0=C2=A0=C2=A0=C2=A0 shared=C2=A0=C2=A0=C2=A0 buffers=C2=A0=
=C2=A0=C2=A0=C2=A0 cached Mem:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0 32187=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 22292=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0 9895=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 164=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1=
9824 -/+ buffers/cache:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 2303=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0 29884 Swap:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0 1983=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1983 
 After crash: date & free -m Fri Jul 31 15:45:01 MDT 2009<=
br>=C2=A015:45:01 up=C2=A0 4:53,=C2=A0 3 users,=C2=A0 load average: 4.45, 3=
..99, 3.80 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0 total=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 used=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0 free=C2=A0=C2=A0=C2=A0=C2=A0 shared=C2=A0=C2=A0=C2=
=A0 buffers=C2=A0=C2=A0=C2=A0=C2=A0 cached 
Mem:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 32187=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0 14726=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 17460=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0 165=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 13850 -/+ buffers/cache:=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 710=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 3147=
7 Swap:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1983=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0 1983</div></blockquote><div> Hm, It looks weird. BTW, I assume=
that 24000 in "DETAIL:=C2=A0 Failed on request of size 24000" is=
size in bytes, but may be it's size in kilobytes? o_O 
 How many connections (active and max) do you have? Are you sure that=
nothing else could eat memory (e.g. some poorly-written cronjob?) How m=
any VIRT memory does postmaster have before the crash? Here is some =
suggersions: 
Check memory limits in /etc/security/limits.conf and in `ulimit -a`. tai=
l /var/log/audit/audit.log (it might be something interesting there especia=
lly if you are running selinux) Try to upgrade to 8.1.17 (it should be s=
afe and fast operation). 
Check your kernerl's shm settings. Check fsm settings. HTH<br=
></div></div> -- Vladimir Rusinov <a href=3D"ht=
tp://greenmice.info/">http://greenmice.info/</a> 

--0016364166e98da3e5047010350f--

>
> Some one know why this is happening?
>
> I change the OS to 64 bits and now the oom-killer not hapend but Postgres=
is
> still showing out of memory
>
> Linux SERVER 2.6.18-92.el5 #1 SMP Tue Apr 29 13:16:15 EDT 2008 x86_64 x86=
_64
> x86_64 GNU/Linux
> Red Hat Enterprise Linux Server release 5.2 (Tikanga)
> PostgreSQL 8.1.15
> 32GB RAM
>
> My postgresql.conf:
> # - Memory -
>
> shared_buffers =3D 1048576=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2 =A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0 # min 16 or
> max_connections*2, 8KB each
> temp_buffers =3D 1024=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2 =A0=C2=A0 # min=
100, 8KB each
> max_prepared_transactions =3D 20=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0 # can be 0 or more
> # note: increasing max_prepared_transactions costs ~600 bytes of shared
> memory
> # per transaction slot, plus lock space (see max_locks_per_transaction).
> work_mem =3D 1024=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 # min 64, size in KB
> maintenance_work_mem =3D 65536=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0 # min 1024, size in KB
> max_stack_depth =3D 2048=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 # min 100, size in KB
>

What about the shmmax and shmall kernel parametters?
Which values you are managing?

--
Emanuel Calvo Franco
www.emanuelcalvofranco.com.ar

--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin

--_5fa4d650-63a5-4bda-8620-82567108ebfd_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

thanks Vladimir and Emanuel

>How many connections (active and max) do you have?
max_connections =3D 2000
Active 1000

>Are you sure that nothing else could eat memory (e.g. some poorly-writte=
n cronjob?)
There are 2 or 3 ligth cronjob's
but the free command show free memory... why? :s

>How many VIRT memory does postmaster have before the crash?
8518m

>Here is some suggersions:
>Check memory limits in /etc/security/limits.conf and in `ulimit -a`.
The config file is the default
[postgres [at] SERVER ~]$ ulimit -a
core file size (blocks=2C -c) 0
data seg size (kbytes=2C -d) unlimited
scheduling priority (-e) 0
file size (blocks=2C -f) unlimited
pending signals (-i) 268287
max locked memory (kbytes=2C -l) 32
max memory size (kbytes=2C -m) unlimited
open files (-n) 1024
pipe size (512 bytes=2C -p) 8
POSIX message queues (bytes=2C -q) 819200
real-time priority (-r) 0
stack size (kbytes=2C -s) 10240
cpu time (seconds=2C -t) unlimited
max user processes (-u) 268287
virtual memory (kbytes=2C -v) unlimited
file locks (-x) unlimited

>tail /var/log/audit/audit.log (it might be something interesting there es=
pecially if you are running selinux)
selinux is disabled

>Try to upgrade to 8.1.17 (it should be safe and fast operation).
I will update

>Check your kernerl's shm settings.
kernel.shmmax =3D 68719476736
kernel.shmall =3D 4294967296
Are the default=2C i think are too big already

>Check fsm settings.
max_fsm_pages =3D 180000

regards...

Date: Sat=2C 1 Aug 2009 12:20:27 +0400
Subject: Re: [ADMIN] out of memory
From: vladimir [at] greenmice.info
To: fabrixio1 [at] hotmail.com
CC: pgsql-admin [at] postgresql.org=3B alvherre [at] commandprompt.com

On Sat=2C Aug 1=2C 2009 at 1:20 AM=2C Fabricio <fabrixio1 [at] hotmail.com> wrot=
e:

Hi

Some one know why this is happening?

I change the OS to 64 bits and now the oom-killer not hapend but Postgres i=
s still showing out of memory

Linux SERVER 2.6.18-92.el5 #1 SMP Tue Apr 29 13:16:15 EDT 2008 x86_64 x86_6=
4 x86_64 GNU/Linux

Red Hat Enterprise Linux Server release 5.2 (Tikanga)
PostgreSQL 8.1.15
32GB RAM

My postgresql.conf:
# - Memory -

shared_buffers =3D 1048576 # min 16 or max_connectio=
ns*2=2C 8KB each

temp_buffers =3D 1024 # min 100=2C 8KB each
max_prepared_transactions =3D 20 # can be 0 or more
# note: increasing max_prepared_transactions costs ~600 bytes of shared mem=
ory
# per transaction slot=2C plus lock space (see max_locks_per_transaction).

work_mem =3D 1024 # min 64=2C size in KB
maintenance_work_mem =3D 65536 # min 1024=2C size in KB
max_stack_depth =3D 2048 # min 100=2C size in KB

kernel messages:
Jul 31 11:50:08 SERVER kernel: postmaster[7686]: segfault at 00007fff3feb1b=
b0 rip 00002b2f7e17e1a8 rsp 00007fff3feb1b90 error 6

Jul 31 15:41:55 SERVER kernel: postmaster[4737]: segfault at 00007fff3feb1b=
b0 rip 00002b2f7e1851a8 rsp 00007fff3feb1b90 error 6

PostgreSQL log:
<2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for con=
nection: Cannot allocate memory

<2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for con=
nection: Cannot allocate memory
<2009-07-31 15:41:55 MDT 10.27.41.74(2606) aforeglobal sysaforeglobal 7423 =
startup> FATAL: out of memory

<2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for con=
nection: Cannot allocate memory
<2009-07-31 15:41:55 MDT 7253 > LOG: could not fork new process for con=
nection: Cannot allocate memory

<2009-07-31 15:41:55 MDT 10.27.36.219(3859) db user 7424 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.20.216.82(1966) db user 7431 startup> FATAL: o=
ut of memory
TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 chunks)=3B 15906=
4 used

MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used
LockTable (locallock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=
=3B 4448 used
Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used
ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used

<2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup> DETAIL: =
Failed on request of size 24000.
TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 chunks)=3B 15906=
4 used

MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used
LockTable (locallock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=
=3B 4448 used
Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used
ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used

<2009-07-31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup> DETAIL: =
Failed on request of size 24000.
TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 chunks)=3B 15906=
4 used

MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used
LockTable (locallock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=
=3B 4448 used
Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used
ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used

<2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 startup> DETAIL: =
Failed on request of size 24000.
<2009-07-31 15:41:55 MDT 10.33.128.38(4461) db user 7438 startup> FATAL: o=
ut of memory

<2009-07-31 15:41:55 MDT 10.33.128.38(4462) db user 7439 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4463) db user 7440 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.20.219.194(3594) db user 7433 startup> FATAL: =
out of memory

<2009-07-31 15:41:55 MDT 10.33.128.38(4464) db user 7441 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.38(4465) db user 7442 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.31(1263) db user 7447 startup> FATAL: o=
ut of memory

<2009-07-31 15:41:55 MDT 10.44.5.43(3498) db user 7450 startup> FATAL: out=
of memory
<2009-07-31 15:41:55 MDT 10.27.36.219(3860) db user 7448 startup> FATAL: o=
ut of memory
<2009-07-31 15:41:55 MDT 10.33.128.10(35976) db user 7460 idle> LOG: unexp=
ected EOF on client connection

<2009-07-31 15:41:55 MDT 7253 > LOG: server process (PID 4737) was term=
inated by signal 11
<2009-07-31 15:41:55 MDT 7253 > LOG: terminating any other active serve=
r processes
<2009-07-31
15:41:55 MDT 10.33.128.10(35976) db user 7460 idle> WARNING:
terminating connection because of crash of another server process

Before crash:

date & free -m
Fri Jul 31 15:40:01 MDT 2009
15:40:01 up 4:48=2C 3 users=2C load average: 2.64=2C 3.04=2C 3.58

total used free shared buffers cached
Mem: 32187 22292 9895 0 164 19824
-/+ buffers/cache: 2303 29884
Swap: 1983 0 1983

After crash:

date & free -m
Fri Jul 31 15:45:01 MDT 2009
15:45:01 up 4:53=2C 3 users=2C load average: 4.45=2C 3.99=2C 3.80

total used free shared buffers cached

Mem: 32187 14726 17460 0 165 13850
-/+ buffers/cache: 710 31477
Swap: 1983 0 1983
Hm=2C It looks weird.
BTW=2C I assume that 24000 in "DETAIL: Failed on request of size 24000" is=
size in bytes=2C but may be it's size in kilobytes? o_O

How many connections (active and max) do you have?
Are you sure that nothing else could eat memory (e.g. some poorly-written c=
ronjob?)
How many VIRT memory does postmaster have before the crash?

Here is some suggersions:

Check memory limits in /etc/security/limits.conf and in `ulimit -a`.
tail /var/log/audit/audit.log (it might be something interesting there espe=
cially if you are running selinux)
Try to upgrade to 8.1.17 (it should be safe and fast operation).

Check your kernerl's shm settings.
Check fsm settings.

HTH

--
Vladimir Rusinov
http://greenmice.info/

____________________________________________________________ _____
Gracias Messenger por estos 10 a=F1os
www.aniversariomessenger.com.mx=

--_5fa4d650-63a5-4bda-8620-82567108ebfd_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style>
..hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 10pt=3B
font-family:Verdana
}
</style>
</head>
<body class=3D'hmmessage'>
 thanks Vladimir and Emanuel =3B =3B =3B >=3BH=
ow many connections (active and max) do you have? max_connections =3D 2000 Active 100=
0 =3B >=3BAre you sure that nothing else could eat memory (e.=
g. some poorly-written cronjob?) There are 2 or 3 =3B ligth cronjob'=
s but the free command show free memory... why? :s =3B &=
gt=3BHow many VIRT memory does postmaster have before the crash? 8518m<=
br> =3B>=3BHere is some suggersions: =3B>=3BCheck memor=
y limits in /etc/security/limits.conf and in `ulimit -a`. The config fil=
e is the default [postgres [at] SERVER ~]$ ulimit -a core file size =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B (blocks=
=2C -c) 0 data seg size =3B =3B =3B =3B =3B =3B&=
nbsp=3B =3B =3B =3B (kbytes=2C -d) unlimited scheduling prio=
rity =3B =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B (-e) 0 file size =3B =3B =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B =
=3B =3B (blocks=2C -f) unlimited pending signals =3B =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B (-i) 268287 max locked memory =
=3B =3B =3B =3B =3B =3B (kbytes=2C -l) 32 max memory=
size =3B =3B =3B =3B =3B =3B =3B =3B (kbyt=
es=2C -m) unlimited open files =3B =3B =3B =3B =3B&n=
bsp=3B =3B =3B =3B =3B =3B =3B = 3B =3B =
=3B =3B =3B =3B =3B =3B =3B (-n) 1024 pipe size&=
nbsp=3B =3B =3B =3B =3B =3B =3B =3B =3B&nbs=
p=3B =3B (512 bytes=2C -p) 8 POSIX message queues =3B =3B&nb=
sp=3B =3B (bytes=2C -q) 819200 real-time priority =3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B =3B =
=3B =3B (-r) 0 stack size =3B =3B =3B =3B =3B&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3 B (kbytes=2C -s=
) 10240 cpu time =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B (seconds=2C -t) un=
limited max user processes =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B (-u) 268287 =
virtual memory =3B =3B =3B =3B =3B =3B = 3B =
=3B =3B (kbytes=2C -v) unlimited file locks =3B =3B =3B&=
nbsp=3B =3B =3B =3B =3B =3B =3B =3B =3B&nbs=
p=3B =3B =3B =3B =3B =3B =3B =3B =3B (-x) u=
nlimited =3B>=3Btail /var/log/audit/audit.log (it might b=
e something interesting there especially if you are running selinux) sel=
inux is disabled =3B>=3BTry to upgrade to 8.1.17 (it should b=
e safe and fast operation). I will update =3B
>=3BCheck your kernerl's shm settings. kernel.shmmax =3D 68719476736<b=
r>kernel.shmall =3D 4294967296 Are the default=2C i think are too big al=
ready =3B>=3BCheck fsm settings. max_fsm_pages =3D 180000 =
 regards... <hr id=3D"stopSpelling">Date:=
Sat=2C 1 Aug 2009 12:20:27 +0400 Subject: Re: [ADMIN] out of memory =
From: vladimir [at] greenmice.info To: fabrixio1 [at] hotmail.com CC: pgsql-adm=
in [at] postgresql.org=3B alvherre [at] commandprompt.com <div class=
=3D"EC_gmail_quote">On Sat=2C Aug 1=2C 2009 at 1:20 AM=2C Fabricio <=3B<a href=3D"mailto:fabrixio1 [at] hotmail.com">fabrixio1 [at] hotmail.=
com</a>>=3B wrote: <blockquote class=3D"EC_gmail_quote" style=
=3D"padding-left: 1ex=3B">

<div>
 Hi Some one know why this is happening? I change the=
OS to 64 bits and now the oom-killer not hapend but Postgres is still show=
ing out of memory Linux SERVER 2.6.18-92.el5 #1 SMP Tue Apr 29 13:16=
:15 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux 
Red Hat Enterprise Linux Server release 5.2 (Tikanga) PostgreSQL 8.1.15<=
br>32GB RAM My postgresql.conf: # - Memory - shared_buffer=
s =3D 1048576 =3B =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B =3B =3B # min 16 or max_connection=
s*2=2C 8KB each 
temp_buffers =3D 1024 =3B =3B =3B =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B # min 100=2C 8KB each max_prepared_tran=
sactions =3D 20 =3B =3B =3B =3B =3B =3B =3B&n bs=
p=3B # can be 0 or more # note: increasing max_prepared_transactions cos=
ts ~600 bytes of shared memory # per transaction slot=2C plus lock space=
(see max_locks_per_transaction). 
work_mem =3D 1024 =3B =3B =3B =3B =3B =3B =3B &n=
bsp=3B =3B =3B =3B =3B =3B =3B = 3B =3B # mi=
n 64=2C size in KB maintenance_work_mem =3D 65536 =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B # min 1=
024=2C size in KB max_stack_depth =3D 2048 =3B =3B =3B =
=3B =3B =3B =3B =3B =3B =3B =3B& nbsp=3B =3B=
=3B =3B =3B =3B # min 100=2C size in KB ker=
nel messages: Jul 31 11:50:08 SERVER kernel: postmaster[7686]: segfault =
at 00007fff3feb1bb0 rip 00002b2f7e17e1a8 rsp 00007fff3feb1b90 error 6 
Jul 31 15:41:55 SERVER kernel: postmaster[4737]: segfault at 00007fff3feb1b=
b0 rip 00002b2f7e1851a8 rsp 00007fff3feb1b90 error 6 PostgreSQL log:=
 <=3B2009-07-31 15:41:55 MDT =3B =3B =3B 7253 >=3B LOG:&=
nbsp=3B could not fork new process for connection: Cannot allocate memory<b=
r>
<=3B2009-07-31 15:41:55 MDT =3B =3B =3B 7253 >=3B LOG: =
=3B could not fork new process for connection: Cannot allocate memory &l=
t=3B2009-07-31 15:41:55 MDT 10.27.41.74(2606) aforeglobal sysaforeglobal 74=
23 startup>=3B FATAL: =3B out of memory 
<=3B2009-07-31 15:41:55 MDT =3B =3B =3B 7253 >=3B LOG: =
=3B could not fork new process for connection: Cannot allocate memory &l=
t=3B2009-07-31 15:41:55 MDT =3B =3B =3B 7253 >=3B LOG: =
=3B could not fork new process for connection: Cannot allocate memory 
<=3B2009-07-31 15:41:55 MDT 10.27.36.219(3859) db user 7424 startup>=3B=
FATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.20.216.82=
(1966) db user 7431 startup>=3B FATAL: =3B out of memory TopMemory=
Context: 164432 total in 6 blocks=3B 5368 free (1 chunks)=3B 159064 used<br=
>
MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used LockTable (lo=
callock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=3B 4448 used<=
br>Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used=
 ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used=
 
<=3B2009-07-31 15:41:55 MDT 10.33.128.38(4458) db user 7434 startup>=3B=
FATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.33.128.38=
(4458) db user 7434 startup>=3B DETAIL: =3B Failed on request of size=
24000. TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 chunk=
s)=3B 159064 used 
MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used LockTable (lo=
callock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=3B 4448 used<=
br>Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used=
 ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used=
 
<=3B2009-07-31 15:41:55 MDT 10.33.128.38(4459) db user 7435 startup>=3B=
FATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.33.128.38=
(4459) db user 7435 startup>=3B DETAIL: =3B Failed on request of size=
24000. TopMemoryContext: 164432 total in 6 blocks=3B 5368 free (1 chunk=
s)=3B 159064 used 
MdSmgr: 0 total in 0 blocks=3B 0 free (0 chunks)=3B 0 used LockTable (lo=
callock hash): 8192 total in 1 blocks=3B 3744 free (0 chunks)=3B 4448 used<=
br>Timezones: 52560 total in 2 blocks=3B 3744 free (0 chunks)=3B 48816 used=
 ErrorContext: 8192 total in 1 blocks=3B 8160 free (4 chunks)=3B 32 used=
 
<=3B2009-07-31 15:41:55 MDT 10.33.128.38(4460) db user 7436 startup>=3B=
FATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.33.128.38=
(4460) db user 7436 startup>=3B DETAIL: =3B Failed on request of size=
24000. <=3B2009-07-31 15:41:55 MDT 10.33.128.38(4461) db user 7438 st=
artup>=3B FATAL: =3B out of memory 
<=3B2009-07-31 15:41:55 MDT 10.33.128.38(4462) db user 7439 startup>=3B=
FATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.33.128.38=
(4463) db user 7440 startup>=3B FATAL: =3B out of memory <=3B200=
9-07-31 15:41:55 MDT 10.20.219.194(3594) db user 7433 startup>=3B FATAL:&=
nbsp=3B out of memory 
<=3B2009-07-31 15:41:55 MDT 10.33.128.38(4464) db user 7441 startup>=3B=
FATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.33.128.38=
(4465) db user 7442 startup>=3B FATAL: =3B out of memory <=3B200=
9-07-31 15:41:55 MDT 10.33.128.31(1263) db user 7447 startup>=3B FATAL:&n=
bsp=3B out of memory 
<=3B2009-07-31 15:41:55 MDT 10.44.5.43(3498) db user 7450 startup>=3B F=
ATAL: =3B out of memory <=3B2009-07-31 15:41:55 MDT 10.27.36.219(3=
860) db user 7448 startup>=3B FATAL: =3B out of memory <=3B2009-=
07-31 15:41:55 MDT 10.33.128.10(35976) db user 7460 idle>=3B LOG: =3B=
unexpected EOF on client connection 
<=3B2009-07-31 15:41:55 MDT =3B =3B =3B 7253 >=3B LOG: =
=3B server process (PID 4737) was terminated by signal 11 <=3B2009-07-=
31 15:41:55 MDT =3B =3B =3B 7253 >=3B LOG: =3B terminatin=
g any other active server processes <=3B2009-07-31
15:41:55 MDT 10.33.128.10(35976) db user 7460 idle>=3B WARNING: =3B
terminating connection because of crash of another server process <b=
r>Before crash: date &=3B free -m Fri Jul 31 15:40:01 MDT 200=
9 =3B15:40:01 up =3B 4:48=2C =3B 3 users=2C =3B load av=
erage: 2.64=2C 3.04=2C 3.58 
=3B =3B =3B =3B =3B =3B =3B&nbs p=3B =3B&nb=
sp=3B =3B =3B total =3B =3B =3B =3B =3B =3B=
used =3B =3B =3B =3B =3B =3B free =3B =3B&=
nbsp=3B =3B shared =3B =3B =3B buffers =3B =3B =
=3B =3B cached Mem: =3B =3B =3B =3B =3B =3B&=
nbsp=3B =3B 32187 =3B =3B =3B =3B =3B 22292 =3B=
=3B =3B =3B =3B =3B 9895 =3B =3B =3B =
=3B =3B =3B =3B =3B =3B 0 =3B =3B =3B =
=3B =3B =3B =3B 164 =3B =3B =3B =3B =3B 198=
24 -/+ buffers/cache: =3B =3B =3B =3B =3B = 3B 23=
03 =3B =3B =3B =3B =3B 29884 Swap: =3B =3B&n=
bsp=3B =3B =3B =3B =3B =3B 1983 =3B =3B =3B=
=3B =3B =3B =3B =3B =3B 0 =3B =3B =3B&=
nbsp=3B =3B =3B 1983 
 After crash: date &=3B free -m Fri Jul 31 15:45:01 MDT 200=
9 =3B15:45:01 up =3B 4:53=2C =3B 3 users=2C =3B load av=
erage: 4.45=2C 3.99=2C 3.80 =3B =3B =3B =3B =3B=
=3B =3B =3B =3B =3B =3B =3B total =3B =
=3B =3B =3B =3B =3B used =3B =3B =3B =3B&nb=
sp=3B =3B free =3B =3B =3B =3B shared =3B =3B&n=
bsp=3B buffers =3B =3B =3B =3B cached 
Mem: =3B =3B =3B =3B =3B =3B =3B =3B 32187&=
nbsp=3B =3B =3B =3B =3B 14726 =3B =3B =3B =
=3B =3B 17460 =3B =3B =3B =3B =3B =3B =3 B&n=
bsp=3B =3B 0 =3B =3B =3B =3B =3B =3B =3B 16=
5 =3B =3B =3B =3B =3B 13850 -/+ buffers/cache: =
=3B =3B =3B =3B =3B =3B =3B 710 =3B =3B&nbs=
p=3B =3B =3B 31477 Swap: =3B =3B =3B =3B =3B=
=3B =3B =3B 1983 =3B =3B =3B =3B =3B =
=3B =3B =3B =3B 0 =3B =3B =3B =3B =3B =
=3B 1983</div></blockquote><div> Hm=2C It looks weird. BTW=2C I assum=
e that 24000 in "DETAIL: =3B Failed on request of size 24000" is size i=
n bytes=2C but may be it's size in kilobytes? o_O 
 How many connections (active and max) do you have? Are you sure that=
nothing else could eat memory (e.g. some poorly-written cronjob?) How m=
any VIRT memory does postmaster have before the crash? Here is some =
suggersions: 
Check memory limits in /etc/security/limits.conf and in `ulimit -a`. tai=
l /var/log/audit/audit.log (it might be something interesting there especia=
lly if you are running selinux) Try to upgrade to 8.1.17 (it should be s=
afe and fast operation). 
Check your kernerl's shm settings. Check fsm settings. HTH </d=
iv></div> -- Vladimir Rusinov <a href=3D"http:/=
/greenmice.info/">http://greenmice.info/</a> 
<hr />=DAnete a la ce=
lebraci=F3n de Messenger <a href=3D'www.aniversariomessenger.com.mx' target=
=3D'_new'>y sigue siendo parte de esta historia</a></body>
</html>=

--_5fa4d650-63a5-4bda-8620-82567108ebfd_--

out of memory

Re: out of memory

Re: out of memory

Re: out of memory

Re: out of memory

Re: out of memory

Re: out of memory

Re: out of memory

Re: out of memory

Re: out of memory

Re: out of memory