fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [13.6% done] [ 15810/  7756 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [19.0% done] [  8606/ 15696 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [22.7% done] [ 16363/  4970 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [26.1% done] [  7020/ 12556 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [31.8% done] [ 10486/  8879 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [34.8% done] [ 11799/  8631 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [40.9% done] [ 15139/  5430 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [45.5% done] [ 13077/  5751 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [50.0% done] [ 10510/  6776 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.2% done] [ 11820/  1875 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.5% done] [  6174/  8427 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  8594/  4636 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.0% done] [  9180/  4254 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [61.5% done] [  8907/  3302 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [65.4% done] [  6499/  4506 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [72.0% done] [ 24722/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [79.2% done] [ 37673/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 35326/     0 kb/s] [eta 00m:03s]
Threads: 2: [VEV] [95.5% done] [ 32405/     0 kb/s] [eta 00m:01s]
fio: (groupid=0): err= 0: pid=29909
  read : io=100MiB, bw=4,974KiB/s, runt= 21079msec
    slat (msec): min=    0, max= 4759, avg=1094.97, stdev=1555.09
    clat (msec): min=    1, max=  285, avg=61.02, stdev=60.19
    bw (KiB/s) : min=   40, max=14384, per=41.49%, avg=6191.33, stdev=4143.20
  write: io=43,540KiB, bw=2,737KiB/s, runt= 16287msec
    slat (msec): min=    0, max=  251, avg= 2.20, stdev=16.59
    clat (msec): min=   11, max=  443, avg=87.40, stdev=59.75
    bw (KiB/s) : min=    0, max= 8886, per=55.51%, avg=4089.32, stdev=3270.65
  cpu          : usr=8.56%, sys=0.57%, ctx=1118
  IO depths    : 1=0.3%, 2=1.7%, 4=42.3%, 8=55.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.1%, 4=0.4%, 10=6.2%, 20=17.3%, 50=24.7%, 100=27.9%
     lat (msec): 250=22.7%, 500=0.4%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=29910
  read : io=100MiB, bw=4,989KiB/s, runt= 21016msec
    slat (msec): min=    0, max= 3646, avg=682.84, stdev=1076.46
    clat (msec): min=    0, max=  500, avg=63.92, stdev=68.88
    bw (KiB/s) : min=  107, max=13292, per=37.07%, avg=5531.79, stdev=3589.94
  write: io=41,132KiB, bw=2,423KiB/s, runt= 17383msec
    slat (msec): min=    0, max=   12, avg= 0.95, stdev= 1.84
    clat (msec): min=    4, max=  258, avg=75.18, stdev=52.21
    bw (KiB/s) : min=    0, max=11054, per=57.65%, avg=4247.13, stdev=3732.43
  cpu          : usr=8.66%, sys=0.25%, ctx=1152
  IO depths    : 1=0.3%, 2=1.7%, 4=45.6%, 8=52.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=1.1%, 10=8.8%, 20=18.3%, 50=22.8%, 100=25.9%
     lat (msec): 250=21.7%, 500=0.8%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=29911
  read : io=100MiB, bw=4,977KiB/s, runt= 21068msec
    slat (msec): min=    0, max= 4402, avg=1006.73, stdev=1373.03
    clat (msec): min=    0, max=  787, avg=60.01, stdev=69.55
    bw (KiB/s) : min=   34, max=13258, per=35.82%, avg=5345.17, stdev=3836.99
  write: io=40,396KiB, bw=2,483KiB/s, runt= 16657msec
    slat (msec): min=    0, max=  696, avg= 6.33, stdev=60.25
    clat (msec): min=    8, max=  256, avg=79.58, stdev=48.96
    bw (KiB/s) : min=    0, max=10804, per=47.52%, avg=3500.70, stdev=3300.52
  cpu          : usr=8.64%, sys=0.44%, ctx=1142
  IO depths    : 1=0.3%, 2=1.6%, 4=44.7%, 8=53.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=1.2%, 10=10.0%, 20=16.4%, 50=24.8%, 100=25.0%
     lat (msec): 250=21.3%, 500=0.8%, 750=0.1%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,923KiB/s, minb=4,974KiB/s, maxb=4,989KiB/s, mint=21016msec, maxt=21079msec
  WRITE: io=122MiB, aggrb=7,367KiB/s, minb=2,423KiB/s, maxb=2,737KiB/s, mint=21016msec, maxt=21079msec

Disk stats (read/write):
  cciss!c0d0: ios=5326/2261, merge=1290/460, ticks=342032/291704, in_queue=633736, util=93.91%
5.52user 0.28system 0:22.63elapsed 25%CPU (0avgtext+0avgdata 0maxresident)k
614400inputs+250168outputs (0major+2368minor)pagefaults 0swaps