encoding error in new Postgres version

This is a multi-part message in MIME format.

------=_NextPart_000_0044_01CA7D75.95EA3400
Content-Type: text/plain;
charset="koi8-r"
Content-Transfer-Encoding: quoted-printable

Good morning



We recently (last month) upgraded from postgres 8.2 to 8.3.

We run linux redhat on our production servers, although a couple

Of our developers run Windows XP 32 bit. They restore a pg_dump

Copy of our production database onto their local machine.



In 8.2 they had no problem. In 8.3, however they now get the following
error

On several tables:



pg_restore: [archiver (db)] COPY failed: ERROR: character 0xe28899 =
of
encoding "UTF8" has no equivalent in "WIN1252"
CONTEXT: COPY emails, line 3923



I've had him change CLIIENT_ENCODING to UTF-8, then to WIN1252 all to no
avail.

I also tried running the pgdump file through the ICONV program on the =
linux
side before

Porting it over.



We don't have this problem in any of our linux environments.



I've attached the developer's postgresql.conf file for your reference. =
Any
help appreciated.



Thank you,



Mark Steben=81Database Administrator

[at] utoRevenueR-"Join the Revenue-tion"
95 Ashley Ave., West Springfield, Ma
413-243-4800 x1512 (Phone) =81 413.732-1824 (Fax)
[at] utoRevenue is a registered trademark and a division of Dominion =
Enterprises




------=_NextPart_000_0044_01CA7D75.95EA3400
Content-Type: text/html;
charset="koi8-r"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:st1=3D"urn:schemas-microsoft-com:office:smarttags" =
xmlns=3D"http://www.w3.org/TR/REC-html40"
xmlns:ns0=3D"urn:schemas-microsoft-com:office:smarttags">

<head>
<meta http-equiv=3DContent-Type content=3D"text/html; charset=3Dkoi8-r">
<meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
name=3D"Street"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
name=3D"City"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
name=3D"address"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
[at] font-face
{font-family:"Franklin Gothic Medium";
panose-1:2 11 6 3 2 1 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:Arial;
color:windowtext;}
[at] page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>

</head>

<body lang=3DEN-US link=3Dblue vlink=3Dpurple>

<div class=3DSection1>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Good morning <o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p> </o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>We recently (last month) upgraded from postgres 8.2 =
to 8.3.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>We run linux redhat on our production servers, =
although a
couple<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Of our developers run Windows XP 32 bit.=9A They =
restore a
pg_dump<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Copy of our production database onto their local =
machine.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p> </o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>In 8.2 they had no problem.=9A In 8.3, however they =
now get
the following error<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>On several tables:=9A <o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p> </o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>=9A=9A <font color=3Dblue><span =
style=3D'color:blue'>pg_restore:
[archiver (db)] COPY failed: ERROR:  character 0xe28899 of encoding
"UTF8" has no equivalent in "WIN1252"<br>
CONTEXT:  COPY emails, line =
3923<o:p></o:p></span></font></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dblue face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:blue'><o:p> </o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'>I’ve had him change
CLIIENT_ENCODING to UTF-8, then to WIN1252 all to no =
avail.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'>I also tried running the pgdump =
file
through the ICONV program on the linux side =
before<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'>Porting it =
over.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'><o:p> </o:p></span></font></p>=


<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'>We don’t have this problem =
in any
of our linux environments.=9A <o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'><o:p> </o:p></span></font></p>=


<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'>I’ve attached the =
developer’s
postgresql.conf =9Afile for your reference.=9A Any help =
appreciated.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'><o:p> </o:p></span></font></p>=


<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'>Thank =
you,<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p> </o:p></span></font></p>

<p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto' ><span
class=3Dspelle><font size=3D2 color=3Dblack face=3D"Franklin Gothic =
Medium"><span
style=3D'font-size:10.0pt;font-family:"Franklin Gothic =
Medium";color:black'>Mark
Steben</span></font></span><span class=3Dspelle><font size=3D2 =
color=3Dred
face=3D"Franklin Gothic Medium"><span =
style=3D'font-size:10.0pt;font-family:"Franklin Gothic Medium";
color:red'>=81</span></font></span><span class=3Dspelle><font size=3D2 =
color=3Dblack
face=3D"Franklin Gothic Medium"><span =
style=3D'font-size:10.0pt;font-family:"Franklin Gothic Medium";
color:black'>Database Administrator</span></font></span><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D5 color=3D"#3366ff" face=3D"Times New =
Roman"><span
style=3D'font-size:16.0pt;color:#3366FF'> [at] </span></font><font size=3D4
color=3D"#3366ff"><span =
style=3D'font-size:14.0pt;color:#3366FF'>utoRevenue</span></font><sup><fo=
nt
color=3D"#3366ff"><span =
style=3D'color:#3366FF'>®</span></font></sup><i><font
size=3D4 color=3D"#3366ff"><span =
style=3D'font-size:14.0pt;color:#3366FF;font-style:
italic'>-</span></font></i><i><font size=3D1 color=3D"#3366ff"><span
style=3D'font-size:7.5pt;color:#3366FF;font-style:italic'>"Join the
Revenue-tion"</span></font></i><i><font size=3D2 color=3Dred
face=3D"Franklin Gothic Medium"><span =
style=3D'font-size:10.0pt;font-family:"Franklin Gothic Medium";
color:red;font-style:italic'><br>
</span></font></i><font size=3D2 face=3D"Franklin Gothic Medium"><span
style=3D'font-size:10.0pt;font-family:"Franklin Gothic =
Medium"'><u7:STREET u4:st=3D"on"><u7:ADDRESS u4:st=3D"on"><u7:ADDRESS =
u5:st=3D"on"><u7:STREET u5:st=3D"on"><u8:address u9:st=3D"on"><u8:Street =
u9:st=3D"on"><ns0:address
w:insAuthor=3D"Mark Steben" w:insDate=3D"2009-12-15T10:47:00Z"
w:endInsAuthor=3D"Mark Steben" =
w:endInsDate=3D"2009-12-15T10:47:00Z"><ns0:Street
w:insAuthor=3D"Mark Steben" w:insDate=3D"2009-12-15T10:47:00Z"
w:endInsAuthor=3D"Mark Steben" =
w:endInsDate=3D"2009-12-15T10:47:00Z"><st1:address
w:st=3D"on"><st1:Street w:st=3D"on"><font color=3Dgray><span =
style=3D'color:gray'>95
Ashley Ave., West</span></font></st1:Street><font =
color=3Dgray><span
style=3D'color:gray'> <st1:City =
w:st=3D"on">Springfield</st1:City></span></font></st1:address><font
color=3Dgray><span style=3D'color:gray'>, =
Ma</u8:Street></u8:address></u7:STREET></u7:ADDRESS></u7:ADDRESS></u7:STR=
EET></span></font></ns0:Street></ns0:address><font
color=3Dgray><span style=3D'color:gray'><br>
413-243-4800 x1512 (Phone) </span></font><font color=3Dred><span
style=3D'color:red'>=81 </span></font><font color=3Dgray><span =
style=3D'color:
gray'>413.732-1824 (Fax<span class=3Dgrame>)</span><br>
</span></font></span></font><font size=3D1 color=3Dgray
face=3D"Franklin Gothic Medium"><span =
style=3D'font-size:7.5pt;font-family:"Franklin Gothic Medium";
color:gray'> [at] utoRevenue is a registered trademark and a division of =
Dominion
Enterprises</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p> </o:p></span></font></p>

</div>

</body>

</html>

------=_NextPart_000_0044_01CA7D75.95EA3400--
Mark Steben [ Di, 15 Dezember 2009 16:58 ] [ ID #2026049 ]

Re: encoding error in new Postgres version

Hello,

nobody did answer so far it seems ...

> In 8.2 they had no problem. In 8.3, however they now get the following
> error
>
> On several tables:

> pg_restore: [archiver (db)] COPY failed: ERROR: character 0xe28899
> of encoding "UTF8" has no equivalent in "WIN1252"
> CONTEXT: COPY emails, line 3923

8.3 is more strict about encodings and locales. What encoding do source
(UTF8?) and target (WIN1252?) data base use? What are the locales (use
binary program pg_controldata on the cluster directories)?

Dump the problematic tables directly in plain text format and go to the
line which causes the error (e.g. line 3923 of data) and check for
characters not defined in WIN1252. If you use an ASCII editor you'll
most likely see a character that is used for 'undefined' characters - a
hollow square, a question mark etc.
http://en.wikipedia.org/wiki/Windows-1252
In your example it seems to be this character:
http://decodeunicode.org/en/u+2219/properties
Clean in it up in the source table if you've identified any problematic
character.

Good luck,

Peter





--
Sent via pgsql-admin mailing list (pgsql-admin [at] postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Jan-Peter.Seifert [ Mi, 03 Februar 2010 00:07 ] [ ID #2031129 ]
Datenbanken » gmane.comp.db.postgresql.admin » encoding error in new Postgres version

Vorheriges Thema: How to increase postgresql performance
Nächstes Thema: Re: Startup proc 30595 exited with status 512 - abort and FATAL 2: XLogFlush