fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.0% done] [ 14024/  4060 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [16.0% done] [ 14206/  5828 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [20.0% done] [ 12410/  4505 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [24.0% done] [ 12008/  5395 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [28.0% done] [ 10153/  6238 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [30.8% done] [  9995/  4115 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [33.3% done] [ 13081/  2583 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.0% done] [ 10395/  4566 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [40.7% done] [ 11208/  3940 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [42.9% done] [  9076/  4668 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [46.4% done] [ 10228/  3400 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [  4800/  7544 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [51.7% done] [  2820/  8552 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [55.2% done] [ 10676/  1932 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [56.7% done] [  8968/  2156 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.0% done] [  7296/  2496 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [61.3% done] [  5840/  4148 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [64.5% done] [  4108/  5352 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [65.6% done] [  6152/  2364 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [68.8% done] [  6956/  2300 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 17984/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [72.7% done] [ 18268/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [78.1% done] [ 18460/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [83.9% done] [ 15448/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=25722
  read : io=100MiB, bw=3,796KiB/s, runt= 27622msec
    slat (msec): min=    0, max= 5781, avg=1097.96, stdev=1790.71
    clat (msec): min=    3, max=  459, avg=91.46, stdev=83.06
    bw (KiB/s) : min=   63, max=11053, per=39.32%, avg=4477.41, stdev=2705.52
  write: io=33,716KiB, bw=1,576KiB/s, runt= 21901msec
    slat (msec): min=    0, max=    3, avg= 0.08, stdev= 0.34
    clat (msec): min=    0, max=  932, avg=124.02, stdev=130.13
    bw (KiB/s) : min=    0, max= 5383, per=58.91%, avg=2436.04, stdev=1918.96
  cpu          : usr=3.32%, sys=0.32%, ctx=1739
  IO depths    : 1=0.1%, 2=0.2%, 4=14.0%, 8=85.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=0.3%, 10=3.7%, 20=11.6%, 50=24.5%, 100=20.8%
     lat (msec): 250=30.1%, 500=8.1%, 750=0.5%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25723
  read : io=100MiB, bw=3,848KiB/s, runt= 27246msec
    slat (msec): min=    0, max= 6038, avg=1173.18, stdev=1835.93
    clat (msec): min=    0, max=  460, avg=91.69, stdev=80.98
    bw (KiB/s) : min=   27, max= 9213, per=37.07%, avg=4221.55, stdev=2425.96
  write: io=27,840KiB, bw=1,345KiB/s, runt= 21188msec
    slat (msec): min=    0, max=    3, avg= 0.05, stdev= 0.29
    clat (msec): min=    0, max=  708, avg=88.76, stdev=84.44
    bw (KiB/s) : min=    0, max= 6091, per=59.49%, avg=2459.80, stdev=2115.42
  cpu          : usr=3.41%, sys=0.29%, ctx=1848
  IO depths    : 1=0.1%, 2=0.3%, 4=13.9%, 8=85.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.7%, 10=4.8%, 20=9.7%, 50=24.2%, 100=24.7%
     lat (msec): 250=29.5%, 500=5.4%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25724
  read : io=100MiB, bw=3,807KiB/s, runt= 27541msec
    slat (msec): min=    0, max= 5378, avg=955.32, stdev=1651.76
    clat (msec): min=    3, max=  469, avg=100.85, stdev=83.86
    bw (KiB/s) : min=   11, max=10862, per=35.04%, avg=3990.52, stdev=2570.49
  write: io=28,072KiB, bw=1,295KiB/s, runt= 22193msec
    slat (msec): min=    0, max=    4, avg= 0.07, stdev= 0.38
    clat (msec): min=    0, max=  778, avg=98.91, stdev=108.93
    bw (KiB/s) : min=    0, max= 6586, per=54.48%, avg=2252.91, stdev=2006.19
  cpu          : usr=3.20%, sys=0.20%, ctx=1795
  IO depths    : 1=0.1%, 2=0.2%, 4=11.6%, 8=88.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.4%, 10=3.1%, 20=10.6%, 50=21.2%, 100=25.8%
     lat (msec): 250=30.2%, 500=7.5%, 750=0.3%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,388KiB/s, minb=3,796KiB/s, maxb=3,848KiB/s, mint=27246msec, maxt=27622msec
  WRITE: io=89,628KiB, aggrb=4,135KiB/s, minb=1,295KiB/s, maxb=1,576KiB/s, mint=27246msec, maxt=27622msec

Disk stats (read/write):
  sda: ios=5019/1777, merge=1421/348, ticks=490004/276152, in_queue=799596, util=99.54%
2.76user 0.26system 0:27.90elapsed 10%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2390minor)pagefaults 0swaps