Re: MySQL 5 is 25% slower then 4.1

[Chenzhou Cui <suppressed>]

After 4 days and a half, my program finished last night. The 1045175762  
rows costed the Java program 109 hours to load. The speed is about 9.6 
million per hour.

I didn't use multiple insert statements and "LOAD DATA INFILE", but only 
"insert into" statement. The Java program reads one line from the source 
file, and then execute an "insert" statement.

The configuration of my server is as follows:
Two Intel Xeon 2.8GHz CPUs
3GB memory
Two RAID 5 of SATA disks

The huge file locates on a RAID, the MySQL server datadir locates on another RAID. The two RAIDs link to the server by Ultra SCSI 320 interface.





Gary Richardson wrote:

> Are you doing single insert statements, multiple insert statements or
> LOAD DATA INFILE statements?
>
> On 12/4/05, Chenzhou Cui <suppressed> wrote:
>  
>
> > Dear  MySQL fans,
> >
> > I have a 260 GB huge file with 1045175762 rows. Two weeks ago, I wrote a
> > Java program to read the huge plain text file into MySQL 4.1.12.  300
> > million of rows could be loaded in one day.
> >
> > Last Thursday, I updated the MySQL to 5.0.16 and then run the same
> > program. Only 225 million of rows can be loaded in one day.
> >
> > In additional to the version difference, the MySQL 4.1.12 was compiled
> > from SRPM packages from RedHat Updates, while the MySQL 5.0.16 is
> > installed directly using the MySQL binary RPM packages for Redhat AS 4.
> >
> > Any information and suggestion are welcome.
> >
> > Regards,
> > Chenzhou CUI
> >
> >
> > --
> > MySQL General Mailing List
> > For list archives: http://lists.mysql.com/mysql
> > To unsubscribe:    http://lists.mysql.com/suppressed
> >
> >
> >    
>
>  

--
============================================================
Chenzhou Cui  (China-VO Project)   
National Astronomical Observatory | Tel: (8610)64841695
Chinese Academy of Sciences       | FAX: (8610)64878240
Datun Road 20A, Chaoyang District | Email: suppressed
Beijing 100012, China             | WWW: www.lamost.org/~cb
============================================================



--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:    http://lists.mysql.com/suppressed