fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [13.6% done] [ 15928/ 10122 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [19.0% done] [ 12902/ 10689 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [23.8% done] [ 13882/  7146 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [28.6% done] [ 11193/  9627 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [33.3% done] [ 20215/  3982 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [38.1% done] [ 21468/  3148 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [45.0% done] [ 21016/  3973 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [50.0% done] [ 15114/  2623 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [52.4% done] [  7138/  9436 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [57.1% done] [  4075/ 11523 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [59.1% done] [  7972/  7386 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [63.6% done] [ 10502/  3103 kb/s] [eta 00m:08s]
Threads: 3: [mmm] [65.2% done] [  9587/  1606 kb/s] [eta 00m:08s]
Threads: 3: [mmm] [66.7% done] [  4299/  4958 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [70.8% done] [ 11604/  3937 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [75.0% done] [ 19678/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.0% done] [ 17185/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 15965/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 15289/     0 kb/s] [eta 00m:04s]
Threads: 2: [EVV] [88.0% done] [ 17363/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=32559
  read : io=100MiB, bw=4,806KiB/s, runt= 21818msec
    slat (msec): min=    0, max= 5391, avg=964.33, stdev=1656.94
    clat (msec): min=    0, max=  396, avg=76.28, stdev=70.98
    bw (KiB/s) : min=   12, max= 9473, per=40.30%, avg=5515.72, stdev=2776.23
  write: io=29,484KiB, bw=1,840KiB/s, runt= 16404msec
    slat (msec): min=    0, max=  191, avg= 2.61, stdev=13.95
    clat (msec): min=    2, max=  265, avg=75.15, stdev=61.59
    bw (KiB/s) : min=    0, max= 9698, per=47.05%, avg=3250.13, stdev=2831.80
  cpu          : usr=7.88%, sys=0.35%, ctx=656
  IO depths    : 1=1.4%, 2=8.9%, 4=57.0%, 8=32.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.6%, 4=0.7%, 10=3.0%, 20=11.0%, 50=31.9%, 100=29.0%
     lat (msec): 250=19.4%, 500=4.2%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32560
  read : io=100MiB, bw=4,668KiB/s, runt= 22462msec
    slat (msec): min=    0, max= 6026, avg=1445.73, stdev=2139.91
    clat (msec): min=    0, max=  325, avg=70.22, stdev=70.97
    bw (KiB/s) : min=   85, max=18497, per=37.62%, avg=5149.71, stdev=3592.01
  write: io=43,396KiB, bw=2,697KiB/s, runt= 16476msec
    slat (msec): min=    0, max=   54, avg= 1.66, stdev= 4.53
    clat (msec): min=    7, max=  304, avg=78.76, stdev=59.44
    bw (KiB/s) : min=    0, max= 8387, per=53.63%, avg=3704.42, stdev=2746.14
  cpu          : usr=7.87%, sys=0.45%, ctx=774
  IO depths    : 1=1.2%, 2=7.3%, 4=57.3%, 8=34.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.2%, 4=0.2%, 10=3.7%, 20=12.3%, 50=34.9%, 100=25.6%
     lat (msec): 250=18.7%, 500=4.4%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32561
  read : io=100MiB, bw=4,562KiB/s, runt= 22982msec
    slat (msec): min=    0, max= 6696, avg=1449.14, stdev=2257.68
    clat (msec): min=    0, max=  359, avg=74.86, stdev=75.05
    bw (KiB/s) : min=   87, max=14637, per=39.11%, avg=5352.97, stdev=3357.53
  write: io=38,280KiB, bw=2,408KiB/s, runt= 16278msec
    slat (msec): min=    0, max=   63, avg= 1.64, stdev= 4.85
    clat (msec): min=    6, max=  395, avg=77.45, stdev=52.95
    bw (KiB/s) : min=    0, max= 8814, per=55.41%, avg=3827.73, stdev=3036.96
  cpu          : usr=8.27%, sys=0.40%, ctx=738
  IO depths    : 1=1.2%, 2=6.9%, 4=58.2%, 8=33.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.6%, 4=0.5%, 10=3.3%, 20=10.0%, 50=32.4%, 100=30.2%
     lat (msec): 250=17.4%, 500=5.4%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,687KiB/s, minb=4,562KiB/s, maxb=4,806KiB/s, mint=21818msec, maxt=22982msec
  WRITE: io=109MiB, aggrb=6,908KiB/s, minb=1,840KiB/s, maxb=2,697KiB/s, mint=21818msec, maxt=22982msec

Disk stats (read/write):
  cciss!c0d0: ios=5230/2256, merge=1349/397, ticks=385768/268768, in_queue=654532, util=98.20%
5.49user 0.28system 0:23.57elapsed 24%CPU (0avgtext+0avgdata 0maxresident)k
614400inputs+222352outputs (0major+2372minor)pagefaults 0swaps