nvme0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=io_uring, iodepth=32 ... fio-3.25 Starting 16 processes nvme0: (groupid=0, jobs=16): err= 0: pid=15807: Sat Mar 25 21:16:24 2023 read: IOPS=330k, BW=1290MiB/s (1353MB/s)(37.8GiB/30003msec) slat (nsec): min=1938, max=225749, avg=14434.23, stdev=6505.65 clat (usec): min=4, max=5997, avg=1533.09, stdev=566.96 lat (usec): min=7, max=6022, avg=1547.96, stdev=568.55 clat percentiles (usec): | 1.00th=[ 196], 5.00th=[ 269], 10.00th=[ 783], 20.00th=[ 1139], | 30.00th=[ 1352], 40.00th=[ 1483], 50.00th=[ 1582], 60.00th=[ 1680], | 70.00th=[ 1795], 80.00th=[ 1942], 90.00th=[ 2180], 95.00th=[ 2409], | 99.00th=[ 2900], 99.50th=[ 3130], 99.90th=[ 3589], 99.95th=[ 3785], | 99.99th=[ 4228] bw ( MiB/s): min= 1077, max= 2530, per=100.00%, avg=1291.45, stdev=38.12, samples=960 iops : min=275929, max=647897, avg=330606.98, stdev=9759.31, samples=960 lat (usec) : 10=0.01%, 20=0.01%, 50=0.01%, 100=0.01%, 250=4.43% lat (usec) : 500=2.36%, 750=2.75%, 1000=5.40% lat (msec) : 2=68.41%, 4=16.63%, 10=0.02% cpu : usr=10.78%, sys=38.14%, ctx=4668658, majf=0, minf=932 IO depths : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0% issued rwts: total=9907939,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=32 Run status group 0 (all jobs): READ: bw=1290MiB/s (1353MB/s), 1290MiB/s-1290MiB/s (1353MB/s-1353MB/s), io=37.8GiB (40.6GB), run=30003-30003msec Disk stats (read/write): nvme0n1: ios=9758021/0, merge=0/0, ticks=16205206/0, in_queue=16205206, util=99.88%