fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8 ... fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8 Starting 3 threads Threads: 3 Threads: 3 Threads: 3: [mmm] [10.7% done] [ 18444/ 0 kb/s] [eta 00m:25s] Threads: 3: [mmm] [14.8% done] [ 14559/ 2458 kb/s] [eta 00m:23s] Threads: 3: [mmm] [17.2% done] [ 7480/ 6834 kb/s] [eta 00m:24s] Threads: 3: [mmm] [21.4% done] [ 8216/ 9020 kb/s] [eta 00m:22s] Threads: 3: [mmm] [23.3% done] [ 8448/ 8232 kb/s] [eta 00m:23s] Threads: 3: [mmm] [27.6% done] [ 6916/ 10556 kb/s] [eta 00m:21s] Threads: 3: [mmm] [29.0% done] [ 6879/ 8464 kb/s] [eta 00m:22s] Threads: 3: [mmm] [30.3% done] [ 3157/ 10036 kb/s] [eta 00m:23s] Threads: 3: [mmm] [33.3% done] [ 8996/ 6708 kb/s] [eta 00m:22s] Threads: 3: [mmm] [36.4% done] [ 7572/ 6261 kb/s] [eta 00m:21s] Threads: 3: [mmm] [39.4% done] [ 10877/ 3811 kb/s] [eta 00m:20s] Threads: 3: [mmm] [42.4% done] [ 9167/ 5050 kb/s] [eta 00m:19s] Threads: 3: [mmm] [45.5% done] [ 4705/ 6619 kb/s] [eta 00m:18s] Threads: 3: [mmm] [47.1% done] [ 6460/ 5050 kb/s] [eta 00m:18s] Threads: 3: [mmm] [50.0% done] [ 8890/ 2336 kb/s] [eta 00m:17s] Threads: 3: [mmm] [52.9% done] [ 5258/ 4811 kb/s] [eta 00m:16s] Threads: 3: [mmm] [55.9% done] [ 6737/ 2677 kb/s] [eta 00m:15s] Threads: 3: [mmm] [58.8% done] [ 5213/ 2194 kb/s] [eta 00m:14s] Bad verify header 626fde80 fio: pid=9089, err=1/file:io_u.c:496, error=Operation not permitted Threads: 2: [mm_] [61.8% done] [ 7289/ 390 kb/s] [eta 00m:13s] Threads: 2: [mm_] [62.9% done] [ 5534/ 1763 kb/s] [eta 00m:13s] Bad verify header 48aa1880 Bad verify header 3c718800 Bad verify header 66e41880 Bad verify header 32011880 fio: pid=9087, err=1/file:io_u.c:496, error=Operation not permitted fio: (groupid=0): err= 1 (file:io_u.c:496, error=Operation not permitted): pid=9087 read : io=69,124KiB, bw=3,153KiB/s, runt= 22447msec slat (msec): min= 0, max= 0, avg= 0.00, stdev= 0.00 clat (msec): min= 3, max= 1320, avg=110.06, stdev=150.99 bw (KiB/s) : min= 103, max= 9166, per=47.02%, avg=3847.97, stdev=2338.56 write: io=33,276KiB, bw=1,532KiB/s, runt= 22231msec slat (msec): min= 0, max= 0, avg= 0.00, stdev= 0.00 clat (msec): min= 0, max= 655, avg=100.09, stdev=133.01 bw (KiB/s) : min= 0, max= 9750, per=59.60%, avg=3275.18, stdev=3016.64 cpu : usr=97.66%, sys=0.69%, ctx=266 IO depths : 1=0.1%, 2=0.2%, 4=6.5%, 8=93.1%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=1.7%, 4=1.0%, 8=4.0%, 16=15.1%, 32=23.9%, 64=17.8%, 128=6.9% lat (msec): 256=12.5%, 512=15.4%, 1024=1.0%, >=2048=0.4% fio: (groupid=0): err= 0: pid=9088 read : io=64,348KiB, bw=2,864KiB/s, runt= 23001msec slat (msec): min= 0, max= 0, avg= 0.00, stdev= 0.00 clat (msec): min= 1, max= 847, avg=118.14, stdev=139.07 bw (KiB/s) : min= 137, max= 7609, per=43.86%, avg=3589.41, stdev=2042.77 write: io=38,052KiB, bw=1,694KiB/s, runt= 22990msec slat (msec): min= 0, max= 0, avg= 0.00, stdev= 0.00 clat (msec): min= 0, max= 723, avg=95.25, stdev=125.41 bw (KiB/s) : min= 0, max= 7474, per=60.05%, avg=3299.76, stdev=2663.17 cpu : usr=97.74%, sys=0.56%, ctx=260 IO depths : 1=0.2%, 2=0.5%, 4=11.3%, 8=88.1%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=2.2%, 4=0.8%, 8=3.4%, 16=10.9%, 32=24.8%, 64=22.0%, 128=6.1% lat (msec): 256=9.6%, 512=19.1%, 1024=0.8%, >=2048=0.0% fio: (groupid=0): err= 1 (file:io_u.c:496, error=Operation not permitted): pid=9089 read : io=50,356KiB, bw=2,550KiB/s, runt= 20215msec slat (msec): min= 0, max= 0, avg= 0.00, stdev= 0.00 clat (msec): min= 3, max= 660, avg=96.79, stdev=120.10 bw (KiB/s) : min= 16, max=10027, per=41.07%, avg=3360.52, stdev=3065.95 write: io=52,044KiB, bw=2,691KiB/s, runt= 19803msec slat (msec): min= 0, max= 0, avg= 0.00, stdev= 0.00 clat (msec): min= 0, max= 543, avg=88.73, stdev=117.16 bw (KiB/s) : min= 0, max=11652, per=66.00%, avg=3626.75, stdev=3280.75 cpu : usr=96.35%, sys=0.51%, ctx=256 IO depths : 1=0.1%, 2=0.3%, 4=11.3%, 8=88.3%, 16=0.0%, 32=0.0%, >=64=0.0% lat (msec): 2=6.0%, 4=3.1%, 8=5.6%, 16=15.8%, 32=22.3%, 64=13.9%, 128=7.0% lat (msec): 256=8.4%, 512=17.6%, 1024=0.1%, >=2048=0.0% Run status group 0 (all jobs): READ: io=180MiB, aggrb=8,183KiB/s, minb=2,550KiB/s, maxb=3,153KiB/s, mint=20215msec, maxt=23001msec WRITE: io=120MiB, aggrb=5,495KiB/s, minb=1,532KiB/s, maxb=2,691KiB/s, mint=20215msec, maxt=23001msec Disk stats (read/write): sda: ios=3417/2380, merge=565/371, ticks=471876/254888, in_queue=726760, util=99.45% Command exited with non-zero status 2 63.92user 0.40system 0:23.28elapsed 276%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (0major+2444minor)pagefaults 0swaps