fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.5% done] [ 17225/  4929 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [16.7% done] [ 22765/   898 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [22.7% done] [ 14748/  7728 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [24.0% done] [ 13284/  3721 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [29.2% done] [  9367/ 11498 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [33.3% done] [ 14098/  5641 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [39.1% done] [ 14138/  5527 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [43.5% done] [  9013/  9054 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [47.8% done] [ 15981/  1997 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [50.0% done] [  9505/  7130 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [54.2% done] [  9607/  5926 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.0% done] [ 10038/  4510 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [60.0% done] [ 10827/  2436 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [61.5% done] [  8871/  2554 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [65.4% done] [  8635/  3062 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.2% done] [  9379/  4128 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 33679/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 26113/     0 kb/s] [eta 00m:05s]
Threads: 1: [VEE] [91.3% done] [ 27728/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=8966
  read : io=100MiB, bw=4,985KiB/s, runt= 21032msec
    slat (msec): min=    0, max= 3423, avg=737.39, stdev=1175.51
    clat (msec): min=    0, max=  804, avg=69.19, stdev=77.20
    bw (KiB/s) : min=   50, max=14860, per=34.76%, avg=5199.03, stdev=3421.11
  write: io=32,156KiB, bw=1,868KiB/s, runt= 17620msec
    slat (msec): min=    0, max=  713, avg= 4.01, stdev=49.20
    clat (msec): min=    3, max=  250, avg=61.32, stdev=44.30
    bw (KiB/s) : min=    0, max=10121, per=51.42%, avg=2786.17, stdev=3216.86
  cpu          : usr=7.74%, sys=0.40%, ctx=1141
  IO depths    : 1=0.2%, 2=1.4%, 4=47.1%, 8=51.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=1.6%, 10=8.6%, 20=15.9%, 50=24.5%, 100=26.9%
     lat (msec): 250=19.4%, 500=2.6%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8967
  read : io=100MiB, bw=5,075KiB/s, runt= 20661msec
    slat (msec): min=    0, max= 3272, avg=452.10, stdev=919.48
    clat (msec): min=    0, max=  396, avg=75.16, stdev=65.65
    bw (KiB/s) : min=   78, max=11710, per=33.09%, avg=4948.74, stdev=2849.19
  write: io=25,972KiB, bw=1,545KiB/s, runt= 17204msec
    slat (msec): min=    0, max=   10, avg= 0.79, stdev= 1.47
    clat (msec): min=    9, max=  595, avg=84.72, stdev=88.43
    bw (KiB/s) : min=    0, max= 7848, per=55.28%, avg=2994.82, stdev=3162.76
  cpu          : usr=8.71%, sys=0.43%, ctx=977
  IO depths    : 1=0.2%, 2=1.3%, 4=46.6%, 8=51.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.0%, 4=0.1%, 10=3.3%, 20=13.8%, 50=25.9%, 100=31.7%
     lat (msec): 250=21.9%, 500=2.8%, 750=0.3%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8968
  read : io=100MiB, bw=4,987KiB/s, runt= 21023msec
    slat (msec): min=    0, max= 4698, avg=1113.44, stdev=1583.42
    clat (msec): min=    1, max=  343, avg=61.68, stdev=66.76
    bw (KiB/s) : min=   19, max=13773, per=38.48%, avg=5755.66, stdev=4143.90
  write: io=35,116KiB, bw=2,195KiB/s, runt= 16376msec
    slat (msec): min=    0, max=   13, avg= 0.75, stdev= 1.62
    clat (msec): min=    6, max=  322, avg=82.15, stdev=54.15
    bw (KiB/s) : min=    0, max= 7241, per=58.15%, avg=3150.76, stdev=2476.46
  cpu          : usr=8.28%, sys=0.40%, ctx=1161
  IO depths    : 1=0.2%, 2=0.8%, 4=43.4%, 8=55.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.0%, 4=0.4%, 10=6.7%, 20=18.5%, 50=26.3%, 100=26.4%
     lat (msec): 250=19.0%, 500=2.5%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,956KiB/s, minb=4,985KiB/s, maxb=5,075KiB/s, mint=20661msec, maxt=21032msec
  WRITE: io=93,244KiB, aggrb=5,418KiB/s, minb=1,545KiB/s, maxb=2,195KiB/s, mint=20661msec, maxt=21032msec

Disk stats (read/write):
  cciss!c0d0: ios=5515/1842, merge=1319/370, ticks=399048/321724, in_queue=720772, util=98.45%
5.23user 0.26system 0:21.52elapsed 25%CPU (0avgtext+0avgdata 0maxresident)k
614400inputs+186520outputs (0major+2361minor)pagefaults 0swaps