very large import

--0-121205969-1312402523=:66952
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

I recently recovered a very large corrupt database with your help. =A0Now I=
'm having a problem during the next step, importing all the data back into =
a clean system. =A0I have a 24GB dump file, the ibdata1 file was about 100G=
B when the disk filled and everything got wrecked. =A0I have a server with =
a lot more drive space now, and the import is working, albeit very very slo=
wly.... =A0The ibdata1 file is growing at about 800MB-1GB per hour. =A0It's=
been running for 24 hours now, and it's only 1/4 of the way thru! =A0 Is t=
here any way to speed up this process? by disabling indexes or something? =
=A0I can't afford to be down for 3 more days... =A0Thanks again,=0A=0Adoug
--0-121205969-1312402523=:66952--
supr_star [ Mi, 03 August 2011 22:15 ] [ ID #2062951 ]

Re: very large import

Quoting supr_star <suprstar1072 [at] yahoo.com>:

> Is there any way to speed up this process? by disabling indexes or
> something?  I can't afford to be down for 3 more days...  

First stop, the mysql documentation:

http://dev.mysql.com/doc/refman/5.1/en/innodb-tuning.html




--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2 [at] m.gmane.org
a.smith [ Mi, 03 August 2011 22:24 ] [ ID #2062952 ]

Re: very large import

The following page has some nice interesting stuff, assuming you have a
reasonable configuration in place (innodb_buffer_pool, etc[1])


http://download.oracle.com/docs/cd/E17952_01/refman-5.5-en/o ptimizing-innodb-bulk-data-loading.html


[1] http://gpshumano.blogs.dri.pt/2009/09/28/importing-wikimedia -dumps/
(second box)

-NT


Em 03-08-2011 21:24, a.smith [at] ukgrid.net escreveu:
> Quoting supr_star <suprstar1072 [at] yahoo.com>:
>
>> Is there any way to speed up this process? by disabling indexes or
>> something? I can't afford to be down for 3 more days...
>
> First stop, the mysql documentation:
>
> http://dev.mysql.com/doc/refman/5.1/en/innodb-tuning.html
>
>
>
>


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2 [at] m.gmane.org
nuno.tavares [ Do, 04 August 2011 02:36 ] [ ID #2062989 ]

Re: very large import

On 8/3/2011 20:36, Nuno Tavares wrote:
> The following page has some nice interesting stuff, assuming you have a
> reasonable configuration in place (innodb_buffer_pool, etc[1])
>
>
> http://download.oracle.com/docs/cd/E17952_01/refman-5.5-en/o ptimizing-innodb-bulk-data-loading.html
>
>...

The same content is also available here:
http://dev.mysql.com/doc/refman/5.5/en/optimizing-innodb-bul k-data-loading.html

It may be an easier address to reach.

--
Shawn Green
MySQL Principal Technical Support Engineer
Oracle USA, Inc. - Hardware and Software, Engineered to Work Together.
Office: Blountville, TN

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2 [at] m.gmane.org
shawn.l.green [ Do, 04 August 2011 14:54 ] [ ID #2062992 ]

RE: very large import

Hi,
I am new to MySQL and this listserv. I have a couple of questions about th=
e recommendations at the link given below.

1) If autocommit is turned off during the large load, could this cause the=
underlying InnoDB log to grow too big?

2) If the unique checks and foreign key checks are turned off during the l=
arge load, are the checks run for the newly loaded data when they are turne=
d back on? If not, what kind of errors would occur later if the loaded dat=
a contained duplicate keys or non-existent foreign keys?

Kay Rozeboom
Information Technology Enterprise
Iowa Department of Administrative Services
Telephone: 515.281.6139 Fax: 515.281.6137
Email: Kay.Rozeboom [at] iowa.gov


-----Original Message-----
From: a.smith [at] ukgrid.net [mailto:a.smith [at] ukgrid.net]
Sent: Wednesday, August 03, 2011 3:25 PM
To: supr_star
Cc: mysql [at] lists.mysql.com
Subject: Re: very large import

Quoting supr_star <suprstar1072 [at] yahoo.com>:

> Is there any way to speed up this process? by disabling indexes or
> something? =A0I can't afford to be down for 3 more days... =A0

First stop, the mysql documentation:

http://dev.mysql.com/doc/refman/5.1/en/innodb-tuning.html


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=3Dgcdmg-mysql-2 [at] m.gmane.o rg
KAY.ROZEBOOM [ Do, 04 August 2011 16:36 ] [ ID #2062995 ]
Datenbanken » gmane.comp.db.mysql.general » very large import

Vorheriges Thema: strange warnings after upgrade...
Nächstes Thema: MySQL Installer 5.5.14.1 RC4 has been released