Home » Groups » STAR Protected

iSCSI SAN Speed Test Results

Updated on Tue, 2009-09-29 11:04. Originally created by ahrem on 2009-09-29 09:35.

The hardware used for testing is as follows:
-iSCSI SAN:
--Hardware Model: Dell PowerEdge R610 1U Rackmount Server
--Hard Drives: 6 73GB 15k RPM 2.5" SAS drives connected via a Dell PERC 6/i RAID Controller
--RAM: 12GB
--Ethernet: Gigabit on local test network
--RAID Layout:
---Drives 0, and 1 mirrored for OS installation
---Drives 2, and 3 mirrored for SAN resources
---Drive 4 JBOD for TimeMark Data
---Drive 5 JBOD for CDP Journal
--SAN Server Software: CentOS 5U1 x86_64 (Kernel 2.6.18-53.1.19.el5) with FalconStor IPStor 6.0 installed (60 Day Trial Key)

-3 Identical Clients:
--Hardware Model: Dell PowerEdge 1750 1U Rackmount Server
--Hard Drives: 3 146GB 10k RPM SCSI drives connected directly to motherboard
--RAM: 2GB
--Ethernet: Gigabit on local test network
--Drive Layout:
---Drive 0 as /
---Drive 1 as /home
---Drive 2 as swap space (2GB swap)
--Client Software: Ubuntu 8.04.2 Server Edition x86 (Kernel 2.6.24-19-generic) with open-iscsi client software (open source)

Network Layout:
-Switch Used: Cisco Catalyst 2948G (48 Port Gigabit Managed Switch)
-Network: 10.7.4.0 network with a 255.255.255.0 subnet (No DHCP/DNS/Campus Access)
-Cisco Switch:
--Hostname: SwitchA.test.local
--IP Address/Subnet: 10.7.4.2/24
-iSCSI SAN:
--Hostname: ipstor.test.local
--IP Address/Subnet: 10.7.4.1/24
-First Client:
--Hostname: clienta.test.local
--IP Address/Subnet: 10.7.4.4/24
-Second Client:
--Hostname: clientb.test.local
--IP Address/Subnet: 10.7.4.3/24
-Third Client:
--Hostname: clientc.test.local
--IP Address/Subnet: 10.7.5.1/24

SAN Resource Layout:
-All 3 Clients:
--Resource Size: 10240MB
--Snapshot Resource Area: 5192MB
--TimeMark: Max 12 TimeMarks on a 2 hour interval
--CDP: Unused
--FileSystem On Client Resource: ext3 mounted at /iscsi/

Test Results:
-IOZone Full Test Results:
Error!
 

Parallel Tests With Small I/O

1 Client

  Block IO Character Random
fwrite fread putc getc seek
Machine KB KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU
NPV_clientbLs__iscsi_ 320000 1586.44 93423.14 2.06 1189.14 214113.60 5.12 1600.58 28330.21 7.35 1300.60 46844.15 9.84 3758.02 3913.91 106.18

2 Clients

  Block IO Character Random
fwrite fread putc getc seek
Machine KB KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU
NPV_clientaLs__iscsi_ 320000 1213.16 107029.33 1.62 1954.37 235108.38 51.12 1180.68 31402.03 5.46 4076.41 47178.34 41.08 4192.01 4230.20 108.79
NPV_clientbLs__iscsi_ 320000 782.34 98149.62 1.03 838.85 217414.55 2.65 830.58 29671.49 3.84 882.42 47419.79 6.14 3445.31 3727.75 102.20

3 Clients

  Block IO Character Random
fwrite fread putc getc seek
Machine KB KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU
NPV_clientaLs__iscsi_ 320000 703.57 109401.73 1.20 1229.89 234094.34 46.25 672.36 32552.30 3.67 1036.80 48550.71 42.39 4202.82 4216.37 109.41
NPV_clientbLs__iscsi_ 320000 441.48 97423.26 0.63 868.57 213191.99 1.00 450.45 28777.51 2.18 858.02 48527.24 2.12 2958.62 3524.17 95.10
NPV_clientcLs__iscsi_ 320000 1081.96 83675.65 1.77 1655.94 195412.53 38.68 958.71 20104.79 6.79 975.29 23467.21 50.47 3229.19 3404.66 104.46

 

Parallel Tests With Large I/O

  Block IO Character Random
fwrite fread putc getc seek
Machine KB KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU
NPV_clientcLl__iscsi_ 320000 1928.14 79626.95 3.86 2033.01 170253.38 30.60 1892.42 19756.23 15.57 1831.47 22787.78 37.49 2556.52 3248.33 92.74

Single Tests With Small I/O

1 Client

  Block IO Character Random
fwrite fread putc getc seek
Machine KB KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU
_clientbLs__iscsi_ 320000 1882.57 84432.72 2.23 40660.74 248062.02 16.39 10578.51 39119.80 27.04 51364.37 51364.37 100.00 4069.01 4069.01 100.00
_clientbLs__iscsi_ 320000 3228.08 103059.58 5.39 69792.80 247104.25 58.20 10675.56 39263.80 27.19 51323.18 51323.18 100.00 4079.63 4079.63 100.00
_clientbLs__iscsi_ 320000 4238.78 112149.53 6.37 91603.05 246153.85 72.13 10786.52 39183.67 27.54 51309.46 51309.46 100.00 4083.19 4083.19 100.00
_clientbLs__iscsi_ 320000 5024.73 116575.59 6.92 108658.74 246153.85 79.10 10775.32 39251.76 27.46 51282.05 51282.05 100.00 4079.63 4079.63 100.00
_clientbLs__iscsi_ 320000 5653.31 119313.94 7.25 122324.16 246153.85 83.28 10820.32 39186.87 27.62 51282.05 51282.05 100.00 4077.51 4077.51 100.00
_clientbLs__iscsi_ 320000 6167.49 121288.69 7.47 133425.99 246153.85 85.94 10851.14 39175.68 27.71 51295.75 51295.75 100.00 4083.19 4083.19 100.00
_clientbLs__iscsi_ 320000 6597.36 122807.02 7.62 142675.16 246153.85 87.84 10816.03 39188.24 27.61 51305.54 51305.54 100.00 4084.20 4084.20 100.00
_clientbLs__iscsi_ 320000 6960.12 123791.10 7.75 150588.24 246153.85 89.36 10809.90 39179.68 27.60 51302.61 51312.89 99.98 4087.64 4087.64 100.00
_clientbLs__iscsi_ 320000 7271.81 124729.32 7.84 157377.05 246153.85 90.54 10779.25 39173.01 27.53 51300.32 51309.46 99.98 4087.94 4087.94 100.00
_clientbLs__iscsi_ 320000 7541.83 125293.66 7.92 163182.05 246153.85 91.41 10749.08 39177.28 27.45 51282.05 51290.27 99.98 4086.04 4086.04 100.00

2 Clients

  Block IO Character Random
fwrite fread putc getc seek
Machine KB KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU
_clientaLs__iscsi_ 320000 5704.10 134453.78 4.24 244274.81 244274.81 100.00 5740.94 39457.46 14.55 50793.65 50793.65 100.00 4069.01 4069.01 100.00
_clientaLs__iscsi_ 320000 5868.87 134736.84 4.36 243346.01 243346.01 100.00 5815.01 39530.57 14.71 51036.68 51036.68 100.00 4069.01 4069.01 100.00
_clientaLs__iscsi_ 320000 5907.33 134831.46 4.38 243037.97 243037.97 100.00 5761.61 39457.46 14.61 51063.83 51063.83 100.00 4069.01 4069.01 100.00
_clientaLs__iscsi_ 320000 5891.56 135306.55 4.36 243346.01 243346.01 100.00 5794.21 39408.87 14.71 51077.41 51077.41 100.00 4069.01 4069.01 100.00
_clientaLs__iscsi_ 320000 5908.64 135021.10 4.38 243531.20 243531.20 100.00 5838.14 39370.08 14.84 51101.88 51101.88 100.00 4069.01 4069.01 100.00
_clientaLs__iscsi_ 320000 5977.58 135593.22 4.41 243346.01 243346.01 100.00 5852.05 39441.25 14.84 51104.60 51104.60 100.00 4065.48 4069.01 99.91
_clientaLs__iscsi_ 320000 6032.37 135839.90 4.45 243213.90 243478.26 99.89 5901.26 39395.01 14.99 51118.21 51118.21 100.00 4065.99 4069.01 99.93
_clientaLs__iscsi_ 320000 6117.08 135378.11 4.53 243114.91 243346.01 99.91 5938.85 39348.29 15.11 51128.42 51128.42 100.00 4061.08 4066.36 99.87
_clientaLs__iscsi_ 320000 6202.62 135338.35 4.60 243243.24 243448.86 99.92 5907.57 39333.52 15.04 51127.29 51127.29 100.00 4059.61 4064.31 99.89
_clientaLs__iscsi_ 320000 6256.48 135249.37 4.65 243161.09 243531.20 99.85 5885.60 39336.20 14.98 51134.55 51134.55 100.00 4029.14 4033.30 99.90
                              |  
_clientbLs__iscsi_ 320000 5907.33 131147.54 4.50 246153.85 246153.85 100.00 5944.64 39167.69 15.18 51364.37 51364.37 100.00 4222.97 4222.97 100.00
_clientbLs__iscsi_ 320000 5942.43 132231.40 4.49 246153.85 246153.85 100.00 5912.24 39143.73 15.10 51405.62 51405.62 100.00 4222.97 4222.97 100.00
_clientbLs__iscsi_ 320000 5873.00 132963.99 4.42 246786.63 246786.63 100.00 5859.02 39215.69 14.94 51364.37 51364.37 100.00 4230.60 4230.60 100.00
_clientbLs__iscsi_ 320000 5902.43 133194.59 4.43 246628.13 246628.13 100.00 5837.55 39215.69 14.89 51364.37 51384.99 99.96 4234.42 4234.42 100.00
_clientbLs__iscsi_ 320000 5861.66 134566.86 4.36 246533.13 246533.13 100.00 5795.63 39254.17 14.77 51364.37 51397.37 99.94 4236.71 4236.71 100.00
_clientbLs__iscsi_ 320000 5847.60 135116.12 4.33 246469.83 246469.83 100.00 5874.43 39159.70 15.02 51364.37 51391.86 99.95 4234.42 4234.42 100.00
_clientbLs__iscsi_ 320000 5876.33 135511.19 4.34 246424.64 246424.64 100.00 5898.00 39153.99 15.08 51364.37 51399.72 99.93 4236.06 4236.06 100.00
_clientbLs__iscsi_ 320000 5872.37 135665.08 4.33 246390.76 246390.76 100.00 5957.92 39185.67 15.23 51364.37 51395.30 99.94 4234.42 4234.42 100.00
_clientbLs__iscsi_ 320000 5862.71 135977.34 4.31 246364.41 246364.41 100.00 6052.96 39194.34 15.50 51364.37 51391.86 99.95 4230.60 4230.60 100.00
_clientbLs__iscsi_ 320000 5873.72 136460.55 4.31 246343.34 246343.34 100.00 6116.91 39182.07 15.68 51364.37 51389.11 99.95 4232.12 4232.12 100.00

3 Clients

  Block IO Character Random
fwrite fread putc getc seek
Machine KB KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU
_clientaLs__iscsi_ 320000 2857.65 135593.22 2.11 240601.50 240601.50 100.00 2869.44 38976.86 7.36 51036.68 51036.68 100.00 4027.06 4027.06 100.00
_clientaLs__iscsi_ 320000 2898.29 138528.14 2.09 240601.50 241509.43 99.62 2859.82 38554.22 7.42 50874.40 50874.40 100.00 4016.71 4016.71 100.00
_clientaLs__iscsi_ 320000 2889.22 138728.32 2.08 241206.03 241813.60 99.75 2898.03 38400.00 7.55 50847.46 50847.46 100.00 4040.95 4040.95 100.00
_clientaLs__iscsi_ 320000 2916.45 138979.37 2.10 241965.97 242424.24 99.81 2861.49 38323.35 7.47 50793.65 50793.65 100.00 4032.26 4032.26 100.00
_clientaLs__iscsi_ 320000 2892.37 139251.52 2.08 242057.49 242424.24 99.85 2919.65 38341.72 7.63 50777.53 50777.53 100.00 4035.38 4035.38 100.00
_clientaLs__iscsi_ 320000 2806.03 139332.37 2.02 242118.54 242730.72 99.75 2786.97 38369.30 7.34 50766.79 50780.22 99.97 4033.99 4033.99 100.00
_clientaLs__iscsi_ 320000 2744.19 139303.48 1.98 242424.24 242950.11 99.78 2914.43 38284.05 7.81 50770.63 50782.14 99.98 4033.00 4033.00 100.00
_clientaLs__iscsi_ 320000 2912.60 139206.09 2.20 242424.24 242884.25 99.81 3049.40 38266.07 8.32 50763.43 50783.57 99.96 4034.86 4034.86 100.00
_clientaLs__iscsi_ 320000 3035.19 139467.31 2.31 242424.24 242833.05 99.83 3052.24 38272.43 8.28 50766.79 50784.69 99.96 4029.37 4029.37 100.00
_clientaLs__iscsi_ 320000 2945.56 139555.17 2.25 242424.24 242792.11 99.85 2948.55 38305.00 8.04 50753.37 50777.53 99.95 4029.14 4029.14 100.00
                              |  
_clientbLs__iscsi_ 320000 2914.39 139737.99 2.09 246153.85 246153.85 100.00 2912.27 39653.04 7.34 51282.05 51282.05 100.00 4155.59 4155.59 100.00
_clientbLs__iscsi_ 320000 2890.04 139130.43 2.08 246153.85 246153.85 100.00 2874.21 39191.67 7.33 51200.00 51200.00 100.00 4133.60 4133.60 100.00
_clientbLs__iscsi_ 320000 2882.02 138728.32 2.08 246153.85 246153.85 100.00 2902.85 39008.53 7.44 51227.32 51227.32 100.00 4133.60 4133.60 100.00
_clientbLs__iscsi_ 320000 2839.84 138979.37 2.04 246153.85 246153.85 100.00 2903.15 38917.60 7.46 51220.49 51220.49 100.00 4133.60 4133.60 100.00
_clientbLs__iscsi_ 320000 2899.76 139251.52 2.09 246153.85 246153.85 100.00 2920.56 38957.88 7.50 51216.39 51216.39 100.00 4124.87 4124.87 100.00
_clientbLs__iscsi_ 320000 2753.99 139332.37 2.00 245838.67 245838.67 100.00 2717.78 38945.23 7.11 51200.00 51200.00 100.00 4122.69 4122.69 100.00
_clientbLs__iscsi_ 320000 2714.66 139390.17 1.97 245883.64 245883.64 100.00 2886.67 38882.14 7.81 51188.30 51188.30 100.00 4124.25 4124.25 100.00
_clientbLs__iscsi_ 320000 2828.48 139206.09 2.09 245917.39 245917.39 100.00 3020.36 38858.53 8.27 51189.76 51189.76 100.00 4125.41 4125.41 100.00
_clientbLs__iscsi_ 320000 2870.47 139197.68 2.12 245943.64 245943.64 100.00 2914.89 38871.64 8.00 51190.90 51190.90 100.00 4126.32 4128.74 99.94
_clientbLs__iscsi_ 320000 2799.11 139251.52 2.07 245964.64 245964.64 100.00 2864.43 38882.14 7.84 51183.62 51191.81 99.98 4129.23 4131.41 99.95
                              |  
_clientcLs__iscsi_ 320000 7342.82 85561.50 8.58 219178.08 219178.08 100.00 6293.02 19184.65 32.80 23357.66 23357.66 100.00 3201.84 3201.84 100.00
_clientcLs__iscsi_ 320000 7184.55 86486.49 8.31 219931.27 219931.27 100.00 6218.42 19081.69 32.59 23357.66 23357.66 100.00 3208.42 3208.42 100.00
_clientcLs__iscsi_ 320000 7078.60 86408.64 8.20 220183.49 220183.49 100.00 6209.97 19077.90 32.55 23357.66 23363.35 99.98 3215.02 3215.02 100.00
_clientcLs__iscsi_ 320000 6951.99 86956.52 8.01 219931.27 219931.27 100.00 6278.20 19101.63 32.88 23357.66 23361.93 99.98 3218.33 3218.33 100.00
_clientcLs__iscsi_ 320000 7038.85 86439.76 8.16 219780.22 219780.22 100.00 6327.36 19077.14 33.19 23361.07 23364.49 99.99 3220.32 3220.32 100.00
_clientcLs__iscsi_ 320000 7041.48 86408.64 8.17 219679.63 219931.27 99.89 6326.61 19049.51 33.23 23360.51 23363.35 99.99 3217.23 3217.23 100.00
_clientcLs__iscsi_ 320000 7153.81 86519.89 8.30 219607.84 219823.36 99.90 6383.22 19057.34 33.52 23360.10 23362.54 99.99 3216.91 3216.91 100.00
_clientcLs__iscsi_ 320000 7153.24 86398.92 8.30 219742.49 219931.27 99.91 6432.32 19036.29 33.83 23359.80 23361.93 99.99 3213.37 3213.37 100.00
_clientcLs__iscsi_ 320000 7190.11 86330.94 8.35 219847.33 220015.28 99.92 6430.44 19037.55 33.82 23359.56 23361.45 99.99 3213.55 3213.55 100.00
_clientcLs__iscsi_ 320000 7188.59 86323.17 8.35 219780.22 219931.27 99.93 6396.16 19040.82 33.63 23357.66 23361.07 99.99 3215.02 3215.02 100.00

Single Tests With large I/O

  Block IO Character Random
fwrite fread putc getc seek
Machine KB KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU KB/sec Real KB/sec CPU %CPU
_clientcLl__iscsi_ 320000 11126.56 86486.49 12.87 231884.06 231884.06 100.00 10233.45 18912.53 54.11 23374.73 23374.73 100.00 3051.76 3051.76 100.00
_clientcLl__iscsi_ 320000 11194.68 86137.28 13.00 231884.06 232727.27 99.64 10176.50 18946.12 53.72 23366.19 23366.19 100.00 3150.20 3150.20 100.00
_clientcLl__iscsi_ 320000 11213.64 85944.49 13.05 231884.06 232445.52 99.76 10310.39 18927.44 54.50 23369.04 23369.04 100.00 3184.44 3184.44 100.00
_clientcLl__iscsi_ 320000 11220.20 85906.04 13.06 232304.90 232727.27 99.82 10222.83 18940.51 54.00 23370.46 23370.46 100.00 3201.84 3201.84 100.00
_clientcLl__iscsi_ 320000 11224.13 86021.51 13.05 232220.61 232558.14 99.86 10278.81 18919.24 54.36 23367.90 23367.90 100.00 3212.38 3212.38 100.00
_clientcLl__iscsi_ 320000 11227.41 86021.51 13.05 232164.45 232445.52 99.88 10312.05 18925.58 54.52 23369.04 23369.04 100.00 3219.44 3219.44 100.00
_clientcLl__iscsi_ 320000 11232.57 85988.48 13.06 232124.35 232365.15 99.90 10277.59 18923.71 54.34 23372.29 23372.29 100.00 3224.50 3224.50 100.00
_clientcLl__iscsi_ 320000 11231.03 85790.88 13.09 232094.29 232304.90 99.91 10245.33 18934.91 54.14 23372.59 23372.59 100.00 3228.31 3228.31 100.00
_clientcLl__iscsi_ 320000 11232.45 85816.45 13.09 232070.91 232258.06 99.92 10217.11 18937.40 53.98 23372.83 23372.83 100.00 3231.27 3231.27 100.00
_clientcLl__iscsi_ 320000 11234.77 85882.98 13.08 232220.61 232389.25 99.93 10220.38 18942.76 53.98 23371.31 23371.31 100.00 3233.65 3233.65 100.00
Groups: