Difference: CephTest (1 vs. 20)

Revision 202011-09-08 - TWikiAdminUser

Line: 1 to 1
Changed:
<
<
META TOPICPARENT name="StorageImplementation"
>
>
META TOPICPARENT name="ORUA.ExperimentalStorage"
 

Revision 192011-02-16 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 6 to 6
 ;;;;; ;;;;;* Set ALLOWTOPICVIEW = TWikiAdminGroup,Main.DongJinLee,Main.MichaelOSullivan,Main.CameronWalker -->
Added:
>
>		%COUNTER_PLUGIN%
 Kclient version (default Kernel) and Ceph version
  • kernel 2.6.36-02063601-generic (23-Nov-2010)
  • ceph version 0.23.2 (commit:5bdae2af8c53adb2e059022c58813e97e7a7ba5d)

Revision 182011-02-10 - TWikiAdminUser

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 83 to 83
  osd journal = /data/osd5/journal
Deleted:
<
<
META FILEATTACHMENT attachment="ddplot.pdf" attr="" comment="" date="1296688651" name="ddplot.pdf" path="ddplot.pdf" size="89461" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="3"
META FILEATTACHMENT attachment="fioplot.pdf" attr="" comment="" date="1294813304" name="fioplot.pdf" path="fioplot.pdf" size="172292" stream="fioplot.pdf" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ceph-start_ver.20-jan_unstable" attr="" comment="" date="1296604323" name="ceph-start_ver.20-jan_unstable" path="ceph-start [ver.20-jan unstable]" size="13180" stream="ceph-start [ver.20-jan unstable]" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ceph-w_ver._20-jan_unstable" attr="" comment="" date="1296604333" name="ceph-w_ver._20-jan_unstable" path="ceph-w [ver. 20-jan unstable]" size="23063" stream="ceph-w [ver. 20-jan unstable]" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ddplot11.pdf" attr="" comment="" date="1296688919" name="ddplot11.pdf" path="ddplot11.pdf" size="89461" stream="ddplot11.pdf" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ddplot111.pdf" attr="" comment="" date="1296690121" name="ddplot111.pdf" path="ddplot111.pdf" size="57133" stream="ddplot111.pdf" tmpFilename="" user="DongJinLee" version="1"

Revision 172011-02-02 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 84 to 84
 
Changed:
<
<

META FILEATTACHMENT attachment="ddplot.pdf" attr="h" comment="" date="1296688568" name="ddplot.pdf" path="ddplot.pdf" size="89461" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="3"
>
>
META FILEATTACHMENT attachment="ddplot.pdf" attr="" comment="" date="1296688651" name="ddplot.pdf" path="ddplot.pdf" size="89461" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="3"
 
META FILEATTACHMENT attachment="fioplot.pdf" attr="" comment="" date="1294813304" name="fioplot.pdf" path="fioplot.pdf" size="172292" stream="fioplot.pdf" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ceph-start_ver.20-jan_unstable" attr="" comment="" date="1296604323" name="ceph-start_ver.20-jan_unstable" path="ceph-start [ver.20-jan unstable]" size="13180" stream="ceph-start [ver.20-jan unstable]" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ceph-w_ver._20-jan_unstable" attr="" comment="" date="1296604333" name="ceph-w_ver._20-jan_unstable" path="ceph-w [ver. 20-jan unstable]" size="23063" stream="ceph-w [ver. 20-jan unstable]" tmpFilename="" user="DongJinLee" version="1"
Added:
>
>
META FILEATTACHMENT attachment="ddplot11.pdf" attr="" comment="" date="1296688919" name="ddplot11.pdf" path="ddplot11.pdf" size="89461" stream="ddplot11.pdf" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ddplot111.pdf" attr="" comment="" date="1296690121" name="ddplot111.pdf" path="ddplot111.pdf" size="57133" stream="ddplot111.pdf" tmpFilename="" user="DongJinLee" version="1"

Revision 162011-02-02 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 90 to 90
 
Changed:
<
<
META FILEATTACHMENT attachment="ddplot.pdf" attr="" comment="" date="1294877700" name="ddplot.pdf" path="ddplot.pdf" size="137216" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="2"
>
>

META FILEATTACHMENT attachment="ddplot.pdf" attr="h" comment="" date="1296688568" name="ddplot.pdf" path="ddplot.pdf" size="89461" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="3"
 
META FILEATTACHMENT attachment="fioplot.pdf" attr="" comment="" date="1294813304" name="fioplot.pdf" path="fioplot.pdf" size="172292" stream="fioplot.pdf" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ceph-start_ver.20-jan_unstable" attr="" comment="" date="1296604323" name="ceph-start_ver.20-jan_unstable" path="ceph-start [ver.20-jan unstable]" size="13180" stream="ceph-start [ver.20-jan unstable]" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ceph-w_ver._20-jan_unstable" attr="" comment="" date="1296604333" name="ceph-w_ver._20-jan_unstable" path="ceph-w [ver. 20-jan unstable]" size="23063" stream="ceph-w [ver. 20-jan unstable]" tmpFilename="" user="DongJinLee" version="1"

Revision 152011-02-01 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 92 to 92
 
META FILEATTACHMENT attachment="ddplot.pdf" attr="" comment="" date="1294877700" name="ddplot.pdf" path="ddplot.pdf" size="137216" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="2"
META FILEATTACHMENT attachment="fioplot.pdf" attr="" comment="" date="1294813304" name="fioplot.pdf" path="fioplot.pdf" size="172292" stream="fioplot.pdf" tmpFilename="" user="DongJinLee" version="1"
Added:
>
>
META FILEATTACHMENT attachment="ceph-start_ver.20-jan_unstable" attr="" comment="" date="1296604323" name="ceph-start_ver.20-jan_unstable" path="ceph-start [ver.20-jan unstable]" size="13180" stream="ceph-start [ver.20-jan unstable]" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="ceph-w_ver._20-jan_unstable" attr="" comment="" date="1296604333" name="ceph-w_ver._20-jan_unstable" path="ceph-w [ver. 20-jan unstable]" size="23063" stream="ceph-w [ver. 20-jan unstable]" tmpFilename="" user="DongJinLee" version="1"

Revision 142011-01-13 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 88 to 88
 
Deleted:
<
<
 
Deleted:
<
<
 
META FILEATTACHMENT attachment="ddplot.pdf" attr="" comment="" date="1294877700" name="ddplot.pdf" path="ddplot.pdf" size="137216" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="2"
META FILEATTACHMENT attachment="fioplot.pdf" attr="" comment="" date="1294813304" name="fioplot.pdf" path="fioplot.pdf" size="172292" stream="fioplot.pdf" tmpFilename="" user="DongJinLee" version="1"

Revision 132011-01-13 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 88 to 88
 
Changed:
<
<
META FILEATTACHMENT attachment="ddplot.pdf" attr="" comment="" date="1294813284" name="ddplot.pdf" path="ddplot.pdf" size="137008" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="1"
>
>

META FILEATTACHMENT attachment="ddplot.pdf" attr="" comment="" date="1294877700" name="ddplot.pdf" path="ddplot.pdf" size="137216" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="2"
 
META FILEATTACHMENT attachment="fioplot.pdf" attr="" comment="" date="1294813304" name="fioplot.pdf" path="fioplot.pdf" size="172292" stream="fioplot.pdf" tmpFilename="" user="DongJinLee" version="1"

Revision 122011-01-12 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 16 to 16
 
  • 1 OSD NODE
  • 1 CLIENT

Added:
>
>

 
  • 1xMON/MDS + 1xOSD NODE (1 OSD, 3 OSDs, 6 OSDs) + CLIENT
e.g.,

Revision 112011-01-12 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 16 to 15
 
  • 1 OSD NODE
  • 1 OSD NODE
  • 1 CLIENT
Deleted:
<
<
  1. 1xMON/MDS + 1xOSD NODE (1 OSD, 3 OSDs, 6 OSDs) + CLIENT
 
Added:
>
>
  • 1xMON/MDS + 1xOSD NODE (1 OSD, 3 OSDs, 6 OSDs) + CLIENT
 e.g., 
[osd]
Line: 44 to 43
  host = ss1
Changed:
<
<
  1. 1xMON/MDS + 2xOSD NODEs (1+1 OSDs, 2+2 OSDs, 3+3 OSDs) + CLIENT
>
>
  • 1xMON/MDS + 2xOSD NODEs (1+1 OSDs, 2+2 OSDs, 3+3 OSDs) + CLIENT
 e.g., 
[osd]

Revision 102011-01-12 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 19 to 19
 
  1. 1xMON/MDS + 1xOSD NODE (1 OSD, 3 OSDs, 6 OSDs) + CLIENT

e.g.,

Changed:
<
<
[osd]
>
>
[osd]
  osd journal = /data/osd$id/journal osd journal size = 10000 filestore journal writeahead = true
Deleted:
<
<		; filestore journal parallel = true
  osd data = /data/osd$id ; debug ms = 1 ; message traffic ; debug osd = 20
Line: 42 to 42
  host = ss1 [osd5] host = ss1
Added:
>
>
 
Deleted:
<
<
 
  1. 1xMON/MDS + 2xOSD NODEs (1+1 OSDs, 2+2 OSDs, 3+3 OSDs) + CLIENT
Deleted:
<
<		 e.g., [osd0]
host = ss1
osd data = /data/osd0
osd journal = /data/osd0/journal
[osd1]
host = ss1
osd data = /data/osd1
osd journal = /data/osd1/journal
[osd2]
host = ss1
osd data = /data/osd2
osd journal = /data/osd2/journal
[osd3]
host = ss2
osd data = /data/osd3
osd journal = /data/osd3/journal
[osd4]
host = ss2
osd data = /data/osd4
osd journal = /data/osd4/journal
[osd5]
host = ss2
osd data = /data/osd5
osd journal = /data/osd5/journal 

<--
;;;;;     ;;;;;* Set ALLOWTOPICVIEW = TWikiAdminGroup,Main.DongJinLee,Main.MichaelOSullivan,Main.CameronWalker
-->

Kclient version (default Kernel) and Ceph version

  • kernel 2.6.36-02063601-generic (23-Nov-2010)
  • ceph version 0.23.2 (commit:5bdae2af8c53adb2e059022c58813e97e7a7ba5d)

Test configuration

  • 1 MON/MDS
  • 1 OSD NODE
  • 1 OSD NODE
  • 1 CLIENT
  1. 1xMON/MDS + 1xOSD NODE (1 OSD, 3 OSDs, 6 OSDs) + CLIENT
 e.g.,
Changed:
<
<
  1. 1xMON/MDS + 2xOSD NODEs (1+1 OSDs, 2+2 OSDs, 3+3 OSDs) + CLIENT
>
>
[osd]
   osd journal size = 10000
   filestore journal writeahead = true
;   filestore journal parallel = true
;   debug ms = 1         ; message traffic
;   debug osd = 20   
;   debug filestore = 20 ; local object storage
;   debug journal = 20   ; local journaling
;   debug monc = 20      ; monitor interaction, startup
[osd0]
   host = ss1
   osd data = /data/osd0
   osd journal = /data/osd0/journal
[osd1]
   host = ss1
   osd data = /data/osd1
   osd journal = /data/osd1/journal
[osd2]
   host = ss1
   osd data = /data/osd2
   osd journal = /data/osd2/journal
[osd3]
   host = ss2
   osd data = /data/osd3
   osd journal = /data/osd3/journal
[osd4]
   host = ss2
   osd data = /data/osd4
   osd journal = /data/osd4/journal
[osd5]
   host = ss2
   osd data = /data/osd5
   osd journal = /data/osd5/journal
 

Revision 92011-01-12 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 17 to 17
 
  • 1 OSD NODE
  • 1 CLIENT
  1. 1xMON/MDS + 1xOSD NODE (1 OSD, 3 OSDs, 6 OSDs) + CLIENT
Added:
>
>		 e.g., 
[osd]
   osd journal = /data/osd$id/journal
   osd journal size = 10000
   filestore journal writeahead = true
;   filestore journal parallel = true
   osd data = /data/osd$id
;   debug ms = 1         ; message traffic
;   debug osd = 20   
;   debug filestore = 20 ; local object storage
;   debug journal = 20   ; local journaling
;   debug monc = 20      ; monitor interaction, startup
[osd0]
   host = ss1
[osd1]
   host = ss1
[osd2]
   host = ss1
[osd3]
   host = ss1
[osd4]
   host = ss1
[osd5]
   host = ss1
  1. 1xMON/MDS + 2xOSD NODEs (1+1 OSDs, 2+2 OSDs, 3+3 OSDs) + CLIENT

e.g., [osd0]
host = ss1
osd data = /data/osd0
osd journal = /data/osd0/journal
[osd1]
host = ss1
osd data = /data/osd1
osd journal = /data/osd1/journal
[osd2]
host = ss1
osd data = /data/osd2
osd journal = /data/osd2/journal
[osd3]
host = ss2
osd data = /data/osd3
osd journal = /data/osd3/journal
[osd4]
host = ss2
osd data = /data/osd4
osd journal = /data/osd4/journal
[osd5]
host = ss2
osd data = /data/osd5
osd journal = /data/osd5/journal 

<--
;;;;;     ;;;;;* Set ALLOWTOPICVIEW = TWikiAdminGroup,Main.DongJinLee,Main.MichaelOSullivan,Main.CameronWalker
-->

Kclient version (default Kernel) and Ceph version

  • kernel 2.6.36-02063601-generic (23-Nov-2010)
  • ceph version 0.23.2 (commit:5bdae2af8c53adb2e059022c58813e97e7a7ba5d)

Test configuration

  • 1 MON/MDS
  • 1 OSD NODE
  • 1 OSD NODE
  • 1 CLIENT
  1. 1xMON/MDS + 1xOSD NODE (1 OSD, 3 OSDs, 6 OSDs) + CLIENT

e.g.,
 
  1. 1xMON/MDS + 2xOSD NODEs (1+1 OSDs, 2+2 OSDs, 3+3 OSDs) + CLIENT
Added:
>
>
 

Revision 82011-01-12 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 6 to 6
 ;;;;; ;;;;;* Set ALLOWTOPICVIEW = TWikiAdminGroup,Main.DongJinLee,Main.MichaelOSullivan,Main.CameronWalker -->
Changed:
<
<		1 MON/MDS 1 OSD NODE 1 OSD NODE 1 CLIENT
>
>		Kclient version (default Kernel) and Ceph version
  • kernel 2.6.36-02063601-generic (23-Nov-2010)
  • ceph version 0.23.2 (commit:5bdae2af8c53adb2e059022c58813e97e7a7ba5d)

Test configuration

  • 1 MON/MDS
  • 1 OSD NODE
  • 1 OSD NODE
  • 1 CLIENT
  1. 1xMON/MDS + 1xOSD NODE (1 OSD, 3 OSDs, 6 OSDs) + CLIENT
  2. 1xMON/MDS + 2xOSD NODEs (1+1 OSDs, 2+2 OSDs, 3+3 OSDs) + CLIENT
 

Revision 72011-01-12 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Line: 6 to 6
 ;;;;; ;;;;;* Set ALLOWTOPICVIEW = TWikiAdminGroup,Main.DongJinLee,Main.MichaelOSullivan,Main.CameronWalker -->
Changed:
<
<		Brief testing with fio benchmark
>
>		1 MON/MDS 1 OSD NODE 1 OSD NODE 1 CLIENT
 
Changed:
<
<
[global]
bs=4k
ioengine=libaio
iodepth=1
size=2g
direct=1
runtime=10
directory=/media/ceph
>
>
 
Deleted:
<
<		 [rand-read] rw=randread stonewall

[rand-write] rw=randwrite stonewall

[seq-read] rw=read stonewall

[seq-write] rw=write stonewall

dlee064@ubuntu-dlee064:~/Dropbox/code/spc1/run$ sudo ./fio fioceph
rand-read: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
rand-write: (g=1): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
seq-read: (g=2): rw=read, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
seq-write: (g=3): rw=write, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
Starting 4 processes
seq-write: Laying out IO file(s) (1 file(s) / 2048MB)
Jobs: 1 (f=1): [___W] [57.7% done] [0K/36K /s] [0/9 iops] [eta 00m:30s]
rand-read: (groupid=0, jobs=1): err= 0: pid=7327
read : io=2228KB, bw=226561B/s, iops=55, runt= 10070msec
slat (usec): min=334, max=6417K, avg=18076.68, stdev=273238.04
clat (usec): min=0, max=7, avg= 0.48, stdev= 0.59
bw (KB/s) : min= 0, max= 1776, per=274.21%, avg=606.00, stdev=769.73
cpu : usr=0.00%, sys=0.00%, ctx=558, majf=0, minf=25
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=557/0, short=0/0
lat (usec): 2=98.56%, 4=1.26%, 10=0.18%

rand-write: (groupid=1, jobs=1): err= 0: pid=7329
write: io=315392B, bw=31180B/s, iops=7, runt= 10115msec
slat (msec): min=84, max=1324, avg=131.35, stdev=144.25
clat (usec): min=0, max=7, avg= 1.19, stdev= 0.86
bw (KB/s) : min= 9, max= 40, per=108.54%, avg=32.56, stdev= 9.14
cpu : usr=0.00%, sys=0.00%, ctx=79, majf=0, minf=23
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=0/77, short=0/0
lat (usec): 2=77.92%, 4=20.78%, 10=1.30%

seq-read: (groupid=2, jobs=1): err= 0: pid=7330
read : io=110676KB, bw=11066KB/s, iops=2766, runt= 10001msec
slat (usec): min=292, max=39473, avg=359.95, stdev=289.00
clat (usec): min=0, max=32, avg= 0.45, stdev= 0.60
bw (KB/s) : min= 9984, max=11368, per=100.37%, avg=11107.37, stdev=296.59
cpu : usr=0.50%, sys=1.30%, ctx=35966, majf=0, minf=27
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=27669/0, short=0/0
lat (usec): 2=99.95%, 4=0.03%, 10=0.01%, 20=0.01%, 50=0.01%

seq-write: (groupid=3, jobs=1): err= 0: pid=7335
write: io=303104B, bw=30090B/s, iops=7, runt= 10073msec
slat (msec): min=91, max=946, avg=136.11, stdev=110.69
clat (usec): min=0, max=6, avg= 1.32, stdev= 0.89
bw (KB/s) : min= 11, max= 39, per=106.68%, avg=30.94, stdev= 7.40
cpu : usr=0.00%, sys=0.00%, ctx=85, majf=0, minf=27
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=0/74, short=0/0
lat (usec): 2=60.81%, 4=37.84%, 10=1.35%


Run status group 0 (all jobs):
READ: io=2228KB, aggrb=221KB/s, minb=226KB/s, maxb=226KB/s, mint=10070msec, maxt=10070msec

Run status group 1 (all jobs):
WRITE: io=308KB, aggrb=30KB/s, minb=31KB/s, maxb=31KB/s, mint=10115msec, maxt=10115msec

Run status group 2 (all jobs):
READ: io=110676KB, aggrb=11066KB/s, minb=11332KB/s, maxb=11332KB/s, mint=10001msec, maxt=10001msec

Run status group 3 (all jobs):
WRITE: io=296KB, aggrb=29KB/s, minb=30KB/s, maxb=30KB/s, mint=10073msec, maxt=10073msec

Generally, both the seq / random write operations appears to be very poor.

-- DongJinLee - 16 Sep 2010

 \ No newline at end of file
Added:
>
>
META FILEATTACHMENT attachment="ddplot.pdf" attr="" comment="" date="1294813284" name="ddplot.pdf" path="ddplot.pdf" size="137008" stream="ddplot.pdf" tmpFilename="" user="DongJinLee" version="1"
META FILEATTACHMENT attachment="fioplot.pdf" attr="" comment="" date="1294813304" name="fioplot.pdf" path="fioplot.pdf" size="172292" stream="fioplot.pdf" tmpFilename="" user="DongJinLee" version="1"

Revision 62011-01-12 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"

Revision 52011-01-12 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"

Brief testing with fio benchmark

Revision 42011-01-12 - MichaelOSullivan

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Changed:
<
<
>
>		 

<-- 
    
 
  • 
 
      

    •  Set ALLOWTOPICVIEW = TWikiAdminGroup,Main.DongJinLee,Main.MichaelOSullivan,Main.CameronWalker

     

 
-->
  Brief testing with fio benchmark

Revision 32011-01-07 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Added:
>
>
 Brief testing with fio benchmark 

[global]

Revision 22010-09-16 - DongJinLee

Line: 1 to 1
 
META TOPICPARENT name="StorageImplementation"
Brief testing with fio benchmark
Line: 26 to 26
  [seq-write] rw=write
Changed:
<
<		stonewall
>
>		stonewall
  dlee064@ubuntu-dlee064:~/Dropbox/code/spc1/run$ sudo ./fio fioceph
rand-read: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
rand-write: (g=1): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
seq-read: (g=2): rw=read, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
seq-write: (g=3): rw=write, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
Starting 4 processes
seq-write: Laying out IO file(s) (1 file(s) / 2048MB)
Jobs: 1 (f=1): [___W] [57.7% done] [0K/36K /s] [0/9 iops] [eta 00m:30s]
rand-read: (groupid=0, jobs=1): err= 0: pid=7327
read : io=2228KB, bw=226561B/s, iops=55, runt= 10070msec
slat (usec): min=334, max=6417K, avg=18076.68, stdev=273238.04
clat (usec): min=0, max=7, avg= 0.48, stdev= 0.59
bw (KB/s) : min= 0, max= 1776, per=274.21%, avg=606.00, stdev=769.73
cpu : usr=0.00%, sys=0.00%, ctx=558, majf=0, minf=25
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=557/0, short=0/0
lat (usec): 2=98.56%, 4=1.26%, 10=0.18%

rand-write: (groupid=1, jobs=1): err= 0: pid=7329
write: io=315392B, bw=31180B/s, iops=7, runt= 10115msec
slat (msec): min=84, max=1324, avg=131.35, stdev=144.25
clat (usec): min=0, max=7, avg= 1.19, stdev= 0.86
bw (KB/s) : min= 9, max= 40, per=108.54%, avg=32.56, stdev= 9.14
cpu : usr=0.00%, sys=0.00%, ctx=79, majf=0, minf=23
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=0/77, short=0/0
lat (usec): 2=77.92%, 4=20.78%, 10=1.30%

seq-read: (groupid=2, jobs=1): err= 0: pid=7330
read : io=110676KB, bw=11066KB/s, iops=2766, runt= 10001msec
slat (usec): min=292, max=39473, avg=359.95, stdev=289.00
clat (usec): min=0, max=32, avg= 0.45, stdev= 0.60
bw (KB/s) : min= 9984, max=11368, per=100.37%, avg=11107.37, stdev=296.59
cpu : usr=0.50%, sys=1.30%, ctx=35966, majf=0, minf=27
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=27669/0, short=0/0
lat (usec): 2=99.95%, 4=0.03%, 10=0.01%, 20=0.01%, 50=0.01%

seq-write: (groupid=3, jobs=1): err= 0: pid=7335
write: io=303104B, bw=30090B/s, iops=7, runt= 10073msec
slat (msec): min=91, max=946, avg=136.11, stdev=110.69
clat (usec): min=0, max=6, avg= 1.32, stdev= 0.89
bw (KB/s) : min= 11, max= 39, per=106.68%, avg=30.94, stdev= 7.40
cpu : usr=0.00%, sys=0.00%, ctx=85, majf=0, minf=27
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=0/74, short=0/0
lat (usec): 2=60.81%, 4=37.84%, 10=1.35%


Run status group 0 (all jobs):
READ: io=2228KB, aggrb=221KB/s, minb=226KB/s, maxb=226KB/s, mint=10070msec, maxt=10070msec

Run status group 1 (all jobs):
WRITE: io=308KB, aggrb=30KB/s, minb=31KB/s, maxb=31KB/s, mint=10115msec, maxt=10115msec

Run status group 2 (all jobs):
READ: io=110676KB, aggrb=11066KB/s, minb=11332KB/s, maxb=11332KB/s, mint=10001msec, maxt=10001msec

Run status group 3 (all jobs):
WRITE: io=296KB, aggrb=29KB/s, minb=30KB/s, maxb=30KB/s, mint=10073msec, maxt=10073msec
Added:
>
>		Generally, both the seq / random write operations appears to be very poor.
 -- DongJinLee - 16 Sep 2010 \ No newline at end of file

Revision 12010-09-16 - DongJinLee

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="StorageImplementation"
Brief testing with fio benchmark 

[global]
bs=4k
ioengine=libaio
iodepth=1
size=2g
direct=1
runtime=10
directory=/media/ceph


[rand-read]
rw=randread
stonewall

[rand-write]
rw=randwrite
stonewall

[seq-read]
rw=read
stonewall

[seq-write]
rw=write
stonewall

dlee064@ubuntu-dlee064:~/Dropbox/code/spc1/run$ sudo ./fio fioceph
rand-read: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
rand-write: (g=1): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
seq-read: (g=2): rw=read, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
seq-write: (g=3): rw=write, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=1
Starting 4 processes
seq-write: Laying out IO file(s) (1 file(s) / 2048MB)
Jobs: 1 (f=1): [___W] [57.7% done] [0K/36K /s] [0/9 iops] [eta 00m:30s]
rand-read: (groupid=0, jobs=1): err= 0: pid=7327
read : io=2228KB, bw=226561B/s, iops=55, runt= 10070msec
slat (usec): min=334, max=6417K, avg=18076.68, stdev=273238.04
clat (usec): min=0, max=7, avg= 0.48, stdev= 0.59
bw (KB/s) : min= 0, max= 1776, per=274.21%, avg=606.00, stdev=769.73
cpu : usr=0.00%, sys=0.00%, ctx=558, majf=0, minf=25
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=557/0, short=0/0
lat (usec): 2=98.56%, 4=1.26%, 10=0.18%

rand-write: (groupid=1, jobs=1): err= 0: pid=7329
write: io=315392B, bw=31180B/s, iops=7, runt= 10115msec
slat (msec): min=84, max=1324, avg=131.35, stdev=144.25
clat (usec): min=0, max=7, avg= 1.19, stdev= 0.86
bw (KB/s) : min= 9, max= 40, per=108.54%, avg=32.56, stdev= 9.14
cpu : usr=0.00%, sys=0.00%, ctx=79, majf=0, minf=23
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=0/77, short=0/0
lat (usec): 2=77.92%, 4=20.78%, 10=1.30%

seq-read: (groupid=2, jobs=1): err= 0: pid=7330
read : io=110676KB, bw=11066KB/s, iops=2766, runt= 10001msec
slat (usec): min=292, max=39473, avg=359.95, stdev=289.00
clat (usec): min=0, max=32, avg= 0.45, stdev= 0.60
bw (KB/s) : min= 9984, max=11368, per=100.37%, avg=11107.37, stdev=296.59
cpu : usr=0.50%, sys=1.30%, ctx=35966, majf=0, minf=27
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=27669/0, short=0/0
lat (usec): 2=99.95%, 4=0.03%, 10=0.01%, 20=0.01%, 50=0.01%

seq-write: (groupid=3, jobs=1): err= 0: pid=7335
write: io=303104B, bw=30090B/s, iops=7, runt= 10073msec
slat (msec): min=91, max=946, avg=136.11, stdev=110.69
clat (usec): min=0, max=6, avg= 1.32, stdev= 0.89
bw (KB/s) : min= 11, max= 39, per=106.68%, avg=30.94, stdev= 7.40
cpu : usr=0.00%, sys=0.00%, ctx=85, majf=0, minf=27
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued r/w: total=0/74, short=0/0
lat (usec): 2=60.81%, 4=37.84%, 10=1.35%


Run status group 0 (all jobs):
READ: io=2228KB, aggrb=221KB/s, minb=226KB/s, maxb=226KB/s, mint=10070msec, maxt=10070msec

Run status group 1 (all jobs):
WRITE: io=308KB, aggrb=30KB/s, minb=31KB/s, maxb=31KB/s, mint=10115msec, maxt=10115msec

Run status group 2 (all jobs):
READ: io=110676KB, aggrb=11066KB/s, minb=11332KB/s, maxb=11332KB/s, mint=10001msec, maxt=10001msec

Run status group 3 (all jobs):
WRITE: io=296KB, aggrb=29KB/s, minb=30KB/s, maxb=30KB/s, mint=10073msec, maxt=10073msec

-- DongJinLee - 16 Sep 2010

View topic | History: r20 < r19 < r18 < r17 | More topic actions...
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2025 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback