• February 23, 2025, 08:54:24 AM
  • Welcome, Guest
Please login or register.

Login with username, password and session length
Advanced search  

News:

This Forum Beta is ONLY for registered owners of D-Link products in the USA for which we have created boards at this time.

Pages: [1] 2

Author Topic: EXT2/3 Performance  (Read 22329 times)

fordem

  • Level 10 Member
  • *****
  • Posts: 2168
EXT2/3 Performance
« on: May 19, 2009, 08:57:56 AM »

I discovered (by accident) that it is possible to have one drive formatted ext2 whilst the other is ext3.  I had removed one drive in an ext2, RAID1 array and then formatted the remaining drive, first in ext2 and then ext3 and then replaced the "missing" drive to see if it would prompt for a format (it didn't).

Here are some read/write performance numbers using NASTester 0.4 - the test end-point is an IBM xSeries 206 server running Windows Server 2008 with 3 Seagate 250GB drives in a RAID5 array on an IBM ServeRAID 7t controller (a relabelled Adaptec 2410SA), 3GHz P4HT processor and 3 GB RAM, onboard Intel PRO1000CT configured for 9000 byte frames through a Netgear GS108T.

These tests are done by mapping a drive letter to each volume and then simply selecting the drive you wish to write to in NASTester, so no changes in hardware or configuration.

200MB file size ..

ext2 - writes at 19.59MB/sec average, reads at 14.66MB/sec
ext3 - writes at 14.69MB/sec average, reads at 14.63MB/sec

1000MB file size

ext2 - writes at 19.34MB/sec average, reads at 21.46MB/sec
ext3 - writes at 14.8MB/sec average, reads at 19.55MB/sec

2000MB file size

ext2 - writes at 7.43MB/sec, average reads at 22.13MB/sec
ext3 - writes at 6.55MB/sec, average, reads at 23.32MB/sec

I don't recall that significant a drop in write speed with a 2GB file size prior to 1.08  ???
Logged
RAID1 is for disk redundancy - NOT data backup - don't confuse the two.

pingjockey

  • Level 1 Member
  • *
  • Posts: 16
Re: EXT2/3 Performance
« Reply #1 on: May 19, 2009, 03:02:48 PM »

Honestly that does not look like a huge performace drop to me. Also, there are a few factors to take into consideration as well. First and most important would be the kernel version which I thought was 2.6.11 or something.

There have vast performance improvements in EXT3 since at least 2.6.20 so I think that if the developers add a newer kernel performance should be vastly improved.

Just my opinion though
Logged

fordem

  • Level 10 Member
  • *****
  • Posts: 2168
Re: EXT2/3 Performance
« Reply #2 on: May 19, 2009, 03:11:06 PM »

Honestly that does not look like a huge performace drop to me.

I'm not sure if we're referring to the same thing ...

Look at the write speed when the file size is 1.5GB (19.3MB/sec) and 2GB (7.43MB/sec), that is a significant drop, and if I recall correctly, prior to 1.08 it was not that big.
Logged
RAID1 is for disk redundancy - NOT data backup - don't confuse the two.

pingjockey

  • Level 1 Member
  • *
  • Posts: 16
Re: EXT2/3 Performance
« Reply #3 on: May 19, 2009, 03:15:41 PM »

If I understand what your talking about is the difference in speed between ext 2 and ext 3?
Logged

Banshee1971

  • Level 3 Member
  • ***
  • Posts: 105
Re: EXT2/3 Performance
« Reply #4 on: May 20, 2009, 07:28:55 PM »

Thanks for this testing. Finally, the difference on the speed are so little, i preferd sacrifice the speed, and get more stability....
Logged

skydreamer

  • Level 1 Member
  • *
  • Posts: 1
Re: EXT2/3 Performance
« Reply #5 on: May 21, 2009, 03:07:48 AM »

For reference and in relation to Fordem's post there is no significant performance drop with 2GB files on v1.07/ext2/9k jumbo frames.

Running warmup...
Running a 200MB file write on drive z: 5 times...
Iteration 1:     17.25 MB/sec
Iteration 2:     19.05 MB/sec
Iteration 3:     19.02 MB/sec
Iteration 4:     18.96 MB/sec
Iteration 5:     19.19 MB/sec
------------------------------
Average (W):     18.69 MB/sec
------------------------------
Running a 200MB file read on drive z: 5 times...
Iteration 1:     25.86 MB/sec
Iteration 2:     23.49 MB/sec
Iteration 3:     26.28 MB/sec
Iteration 4:     25.35 MB/sec
Iteration 5:     26.23 MB/sec
------------------------------
Average (R):     25.44 MB/sec
------------------------------
Running warmup...
Running a 2000MB file write on drive z: 5 times...
Iteration 1:     18.66 MB/sec
Iteration 2:     18.34 MB/sec
Iteration 3:     12.78 MB/sec
Iteration 4:     18.46 MB/sec
Iteration 5:     18.65 MB/sec
------------------------------
Average (W):     17.38 MB/sec
------------------------------
Running a 2000MB file read on drive z: 5 times...
Iteration 1:     27.97 MB/sec
Iteration 2:     27.62 MB/sec
Iteration 3:     27.71 MB/sec
Iteration 4:     26.49 MB/sec
Iteration 5:     27.75 MB/sec
------------------------------
Average (R):     27.51 MB/sec
------------------------------
Logged

fordem

  • Level 10 Member
  • *****
  • Posts: 2168
Re: EXT2/3 Performance
« Reply #6 on: May 21, 2009, 04:47:33 PM »

If I understand what your talking about is the difference in speed between ext 2 and ext 3?

The purpose of the exercise was to determine how much of a penalty was created by the journalling - or as you put it the difference in speed between ext2 & ext3, however, it also seems to have revealed an anomaly, either in the new firmware or in my testing.

With 1.08 firmware there is a decrease in write speed with 2GB files as compared to 1.5GB files that I do not recall being there with 1.07, I have not yet reflashed 1.07 to verify this.
Logged
RAID1 is for disk redundancy - NOT data backup - don't confuse the two.

Geraner

  • Level 2 Member
  • **
  • Posts: 75
Re: EXT2/3 Performance
« Reply #7 on: May 22, 2009, 07:50:09 AM »

I just read somewhere on the internet:

"EXT3 is a journalling file system, which tends to speed up file operations and recovery. Unfortunately it requires more memory and CPU time, so it is not so good on earlier machines. It is much faster on later machines, and more easily recoverable."


Maybe this is the reason why writing and reading with EXT3 is slower then with EXT2?

Also here some nice information about EXT3
http://www.linuxplanet.com/linuxplanet/reports/4136/1/
"Using the "journal" mode requires that an ext3 filesystem write every change to a filesystem twice - once to the journal, and then again to the filesystem itself. This can reduce the overall performance of your filesystem, but is the mode most beloved by users, because it minimizes the chances of losing changes to your files since both metatdata and data updates are recorded in the ext3 journal and can be replayed when a system reboots."
« Last Edit: May 22, 2009, 08:00:23 AM by Geraner »
Logged
DIR-825 - HW: B1 - Firmware: 2.05WW Build05 Beta01
DNS-323 - HW: B1- Firmware: 1.08 Beta build 05

pingjockey

  • Level 1 Member
  • *
  • Posts: 16
Re: EXT2/3 Performance
« Reply #8 on: May 22, 2009, 03:59:49 PM »

So what it comes down to is a performance hit or a reliability hit. I think I will go with the performance hit.
Logged

Geraner

  • Level 2 Member
  • **
  • Posts: 75
Re: EXT2/3 Performance
« Reply #9 on: May 23, 2009, 02:40:48 AM »

Tested the FTP file transfer on the DNS-323 with firmware 1.08 with different conifgurations
TLS/SSL activated
Gigabit wired LAN connection via DIR-655.
Two file sizes where tested. 150 MB file and a 1,2 GB file.
Made two to three transfers and too the average sped.

EXT2 - RAID0
Sending to DNS-323 = 20,09 MB/sec

EXT2 - RAID1
Sending to DNS-323 = 16,96 MB/sec
Receiving from DNS-323 = 7,72 MB/sec

EXT3 - RAID0
Sending to DNS-323 = 13,71 MB/sec
Receiving from DNS-323 = 7,32 MB/sec

EXT3 - RAID0 - Jumbo Frames = 9000
Sending to DNS-323 = 11,35 MB/sec
Receiving from DNS-323 = 8,03 MB/sec

EXT3 - RAID1
Sending to DNS-323 = 11,95 MB/sec
Receiving from DNS-323 = 7,95 MB/sec

Performance EXT2 vs EXT3
RAID0 - Sending files = -19,15%
RAID1 - Sending files = -29,53%
« Last Edit: May 23, 2009, 02:52:53 AM by Geraner »
Logged
DIR-825 - HW: B1 - Firmware: 2.05WW Build05 Beta01
DNS-323 - HW: B1- Firmware: 1.08 Beta build 05

gunrunnerjohn

  • Level 11 Member
  • *
  • Posts: 2717
Re: EXT2/3 Performance
« Reply #10 on: September 04, 2009, 12:36:55 PM »

I'm curious why the slow performance reading from the drive?  I have my DNS-323 on a gigabit network, 4k jumbo frames, and I get a LOT better performance from a RAID1 array!  I just dragged a 642mb file

642 MB (673,941,504 bytes)

From the DNS-323 to my desktop, it was finished in 31 seconds.  That computes out to 20.73 mbytes/sec reading from the DNS-323.  I did copy it several times with identical results.  Each time I copied another file to flush any buffers.

7.72 mbytes/sec sucks IMO!  :o
Logged
Microsoft MVP - Windows Desktop Experience
Remember: Data you don't have two copies of is data you don't care about!
PS: RAID of any level is NOT a second copy.

fordem

  • Level 10 Member
  • *****
  • Posts: 2168
Re: EXT2/3 Performance
« Reply #11 on: September 04, 2009, 03:28:53 PM »

gunrunnerjohn - does your post refer to the one immediately above it?

One possible cause is the write speed of the disks in the system receiving the transfer.
Logged
RAID1 is for disk redundancy - NOT data backup - don't confuse the two.

gunrunnerjohn

  • Level 11 Member
  • *
  • Posts: 2717
Re: EXT2/3 Performance
« Reply #12 on: September 04, 2009, 04:47:31 PM »

Correct, it was the post right above.  It's hard to imagine a SATA hard disk that would limit the performance like that, I sure don't know of any.  ???
Logged
Microsoft MVP - Windows Desktop Experience
Remember: Data you don't have two copies of is data you don't care about!
PS: RAID of any level is NOT a second copy.

fordem

  • Level 10 Member
  • *****
  • Posts: 2168
Re: EXT2/3 Performance
« Reply #13 on: September 04, 2009, 06:34:34 PM »

Perhaps I should rephrase then - one possible cause is the write speed of the disk subsystem in the system receiving the transfer.

One of the desktops I use is a Dell Optiplex - 3.06GHz hyperthreading Pentium IV, 1GB RAM and onboard broadcom gigabit - equipped with an 80GB SATA Maxtor disk, copying from the DNS-323 to the Optiplex maxes out at 5~6MB/sec.

I have several of those Maxtor drives and the drive itself is not the bottleneck.
Logged
RAID1 is for disk redundancy - NOT data backup - don't confuse the two.

gunrunnerjohn

  • Level 11 Member
  • *
  • Posts: 2717
Re: EXT2/3 Performance
« Reply #14 on: September 05, 2009, 09:28:57 AM »

I'm still not getting how this is possible.  Since you state the drive is not the problem, clearly the DNS-323 is capable of faster speeds in any disk configuration, and even with any firmware version.  So, what is the explanation of the slow speed?  I have never seen those speeds, even with 100mbit connections to the DNS-323!
Logged
Microsoft MVP - Windows Desktop Experience
Remember: Data you don't have two copies of is data you don't care about!
PS: RAID of any level is NOT a second copy.
Pages: [1] 2