fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.5% done] [ 17017/  3063 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [19.0% done] [ 15981/  7012 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [22.7% done] [  9615/ 11942 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [27.3% done] [  3933/ 17026 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [31.8% done] [ 13064/  7923 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [36.4% done] [  9992/  9142 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [40.9% done] [ 14606/  4889 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [43.5% done] [  9668/  8269 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [44.0% done] [  9912/  5682 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [50.0% done] [ 10888/  4697 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [52.0% done] [ 12894/  2835 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [56.0% done] [ 13047/  1101 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [60.0% done] [  7000/  6536 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [61.5% done] [  7919/  4091 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [63.0% done] [  6626/  4693 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [69.2% done] [ 15131/  1147 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 31771/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.3% done] [ 31604/     0 kb/s] [eta 00m:04s]
Threads: 2: [VVE] [87.5% done] [ 31909/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=18158
  read : io=100MiB, bw=4,944KiB/s, runt= 21209msec
    slat (msec): min=    0, max= 3480, avg=775.17, stdev=1148.40
    clat (msec): min=    0, max=  882, avg=61.48, stdev=75.42
    bw (KiB/s) : min=    3, max=16270, per=37.44%, avg=5552.39, stdev=4257.77
  write: io=41,248KiB, bw=2,384KiB/s, runt= 17714msec
    slat (msec): min=    0, max=  804, avg= 6.22, stdev=63.99
    clat (msec): min=    8, max=  267, avg=89.94, stdev=53.91
    bw (KiB/s) : min=    0, max= 8544, per=60.15%, avg=3709.37, stdev=3045.53
  cpu          : usr=8.60%, sys=0.62%, ctx=1128
  IO depths    : 1=0.1%, 2=1.3%, 4=45.6%, 8=53.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.7%, 4=0.5%, 10=9.5%, 20=18.0%, 50=23.1%, 100=22.7%
     lat (msec): 250=24.1%, 500=1.0%, 750=0.0%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=18159
  read : io=100MiB, bw=4,983KiB/s, runt= 21040msec
    slat (msec): min=    0, max= 3774, avg=566.35, stdev=1058.14
    clat (msec): min=    1, max=  316, avg=69.29, stdev=62.78
    bw (KiB/s) : min=   35, max=11789, per=34.66%, avg=5140.89, stdev=3364.76
  write: io=32,188KiB, bw=1,925KiB/s, runt= 17114msec
    slat (msec): min=    0, max=  156, avg= 3.58, stdev=17.62
    clat (msec): min=    0, max=  285, avg=82.50, stdev=55.62
    bw (KiB/s) : min=    0, max= 6312, per=52.27%, avg=3223.67, stdev=2325.20
  cpu          : usr=8.42%, sys=0.44%, ctx=1137
  IO depths    : 1=0.2%, 2=1.2%, 4=43.2%, 8=55.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.2%, 4=0.0%, 10=2.6%, 20=16.1%, 50=27.3%, 100=29.2%
     lat (msec): 250=22.4%, 500=2.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=18160
  read : io=100MiB, bw=4,986KiB/s, runt= 21029msec
    slat (msec): min=    0, max= 4346, avg=921.10, stdev=1392.81
    clat (msec): min=    0, max=  333, avg=67.61, stdev=63.41
    bw (KiB/s) : min=   66, max=12045, per=39.76%, avg=5897.40, stdev=3284.77
  write: io=33,248KiB, bw=2,032KiB/s, runt= 16752msec
    slat (msec): min=    0, max=   41, avg= 0.84, stdev= 2.74
    clat (msec): min=    2, max=  238, avg=72.10, stdev=45.81
    bw (KiB/s) : min=    0, max= 9636, per=75.27%, avg=4641.77, stdev=3460.74
  cpu          : usr=8.22%, sys=0.53%, ctx=1119
  IO depths    : 1=0.2%, 2=1.7%, 4=43.7%, 8=54.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=0.5%, 10=7.2%, 20=14.4%, 50=26.4%, 100=26.8%
     lat (msec): 250=23.3%, 500=1.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,832KiB/s, minb=4,944KiB/s, maxb=4,986KiB/s, mint=21029msec, maxt=21209msec
  WRITE: io=104MiB, aggrb=6,167KiB/s, minb=1,925KiB/s, maxb=2,384KiB/s, mint=21029msec, maxt=21209msec

Disk stats (read/write):
  cciss!c0d0: ios=5487/1969, merge=1333/488, ticks=380508/247036, in_queue=627536, util=99.49%
5.37user 0.35system 0:21.42elapsed 26%CPU (0avgtext+0avgdata 0maxresident)k
614400inputs+213400outputs (0major+2366minor)pagefaults 0swaps