fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [5.8% done] [  2396/     0 kb/s] [eta 00m:49s]
Threads: 3: [mFm] [7.1% done] [  2166/   616 kb/s] [eta 00m:52s]
Threads: 3: [mFm] [8.3% done] [  2360/ 14592 kb/s] [eta 00m:55s]
Threads: 3: [mFm] [10.0% done] [  1700/   608 kb/s] [eta 00m:54s]
Threads: 3: [mFm] [11.7% done] [  2880/   404 kb/s] [eta 00m:53s]
Threads: 3: [mFm] [13.3% done] [  2676/  6316 kb/s] [eta 00m:52s]
Threads: 3: [FFm] [32.1% done] [  1564/ 37204 kb/s] [eta 00m:19s]
Threads: 3: [FFF] [100.0% done] [     0/ 54680 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [ 11119/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 29712/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.6% done] [ 32349/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [87.0% done] [ 32920/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.5% done] [ 30843/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 34542/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28691/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36224/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 32612/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=8992
  read : io=100MiB, bw=4,047KiB/s, runt= 25887msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  763, avg=77.58, stdev=137.39
    bw (KiB/s) : min=   10, max=18736, per=46.02%, avg=5577.88, stdev=5642.53
  write: io=94,632KiB, bw=5,877KiB/s, runt= 16488msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  511, avg= 5.16, stdev=37.56
    bw (KiB/s) : min=    0, max=68928, per=86.24%, avg=15215.50, stdev=26574.29
  cpu          : usr=4.76%, sys=1.42%, ctx=5562
  IO depths    : 1=2.8%, 2=54.7%, 4=28.6%, 8=13.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=40.0%, 4=6.8%, 10=17.3%, 20=15.1%, 50=6.8%, 100=1.1%
     lat (msec): 250=7.4%, 500=3.4%, 750=1.9%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8993
  read : io=100MiB, bw=4,113KiB/s, runt= 25490msec
    clat (msec): min=    0, max=  633, avg=41.85, stdev=79.49
    bw (KiB/s) : min=   10, max=15184, per=91.14%, avg=11046.75, stdev=3803.56
  write: io=100MiB, bw=6,364KiB/s, runt= 16476msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   15, avg= 0.58, stdev= 1.25
    bw (KiB/s) : min=    0, max=69664, per=261.12%, avg=46072.00, stdev=39903.40
  cpu          : usr=5.02%, sys=1.77%, ctx=5370
  IO depths    : 1=3.0%, 2=59.5%, 4=29.2%, 8=8.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.2%, 4=6.8%, 10=22.6%, 20=15.1%, 50=3.4%, 100=0.1%
     lat (msec): 250=6.7%, 500=0.7%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=8994
  read : io=100MiB, bw=4,041KiB/s, runt= 25946msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1102, avg=74.61, stdev=164.12
    bw (KiB/s) : min=    5, max=13935, per=42.51%, avg=5152.66, stdev=4751.46
  write: io=87,080KiB, bw=5,409KiB/s, runt= 16484msec
    slat (msec): min=    0, max=    1, avg= 0.00, stdev= 0.02
    clat (msec): min=    0, max=  834, avg= 6.87, stdev=59.69
    bw (KiB/s) : min=    0, max=139706, per=159.43%, avg=28129.20, stdev=62373.52
  cpu          : usr=2.48%, sys=1.34%, ctx=5732
  IO depths    : 1=2.4%, 2=56.8%, 4=28.8%, 8=12.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=49.1%, 4=0.0%, 10=17.9%, 20=17.9%, 50=3.3%, 100=1.4%
     lat (msec): 250=5.7%, 500=2.2%, 750=1.4%, 1000=0.8%, >=2000=0.2%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,120KiB/s, minb=4,041KiB/s, maxb=4,113KiB/s, mint=25490msec, maxt=25946msec
  WRITE: io=277MiB, aggrb=17,644KiB/s, minb=5,409KiB/s, maxb=6,364KiB/s, mint=25490msec, maxt=25946msec

Disk stats (read/write):
  sda: ios=3376/2244, merge=1130/68709, ticks=108924/1865832, in_queue=1974760, util=98.97%
3.18user 1.22system 0:26.41elapsed 16%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2478minor)pagefaults 0swaps