[SOLVED] Slackware64 -current, 6.1.38 huge kernel, slow nvme performance
by bennyt from LinuxQuestions.org on (#6D1FD)
Hi,
As title, I've just updated the OS to recent -current and my nvme is reporting like 23 MB/s.
Code:fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=10G --readwrite=randrw --rwmixread=75
test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.29
Starting 1 process
test: Laying out IO file (1 file / 10240MiB)
Jobs: 1 (f=1): [m(1)][100.0%][r=65.3MiB/s,w=21.5MiB/s][r=16.7k,w=5506 IOPS][eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=5226: Mon Jul 17 08:48:31 2023
read: IOPS=17.2k, BW=67.1MiB/s (70.4MB/s)(7678MiB/114398msec)
bw ( KiB/s): min=34888, max=140712, per=100.00%, avg=68813.02, stdev=15255.58, samples=228
iops : min= 8722, max=35178, avg=17203.19, stdev=3813.89, samples=228
write: IOPS=5734, BW=22.4MiB/s (23.5MB/s)(2562MiB/114398msec); 0 zone resets
bw ( KiB/s): min=12120, max=46648, per=100.00%, avg=22967.66, stdev=5045.73, samples=228
iops : min= 3030, max=11662, avg=5741.86, stdev=1261.44, samples=228
cpu : usr=4.25%, sys=27.91%, ctx=990533, majf=0, minf=7
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwts: total=1965456,655984,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=67.1MiB/s (70.4MB/s), 67.1MiB/s-67.1MiB/s (70.4MB/s-70.4MB/s), io=7678MiB (8051MB), run=114398-114398msec
WRITE: bw=22.4MiB/s (23.5MB/s), 22.4MiB/s-22.4MiB/s (23.5MB/s-23.5MB/s), io=2562MiB (2687MB), run=114398-114398msecI'm not sure what performance was before the update, but now I cannot run some I/O intensive apps, so something seems to have got worse.
Any ideas? Thanks.
As title, I've just updated the OS to recent -current and my nvme is reporting like 23 MB/s.
Code:fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=10G --readwrite=randrw --rwmixread=75
test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.29
Starting 1 process
test: Laying out IO file (1 file / 10240MiB)
Jobs: 1 (f=1): [m(1)][100.0%][r=65.3MiB/s,w=21.5MiB/s][r=16.7k,w=5506 IOPS][eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=5226: Mon Jul 17 08:48:31 2023
read: IOPS=17.2k, BW=67.1MiB/s (70.4MB/s)(7678MiB/114398msec)
bw ( KiB/s): min=34888, max=140712, per=100.00%, avg=68813.02, stdev=15255.58, samples=228
iops : min= 8722, max=35178, avg=17203.19, stdev=3813.89, samples=228
write: IOPS=5734, BW=22.4MiB/s (23.5MB/s)(2562MiB/114398msec); 0 zone resets
bw ( KiB/s): min=12120, max=46648, per=100.00%, avg=22967.66, stdev=5045.73, samples=228
iops : min= 3030, max=11662, avg=5741.86, stdev=1261.44, samples=228
cpu : usr=4.25%, sys=27.91%, ctx=990533, majf=0, minf=7
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwts: total=1965456,655984,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=67.1MiB/s (70.4MB/s), 67.1MiB/s-67.1MiB/s (70.4MB/s-70.4MB/s), io=7678MiB (8051MB), run=114398-114398msec
WRITE: bw=22.4MiB/s (23.5MB/s), 22.4MiB/s-22.4MiB/s (23.5MB/s-23.5MB/s), io=2562MiB (2687MB), run=114398-114398msecI'm not sure what performance was before the update, but now I cannot run some I/O intensive apps, so something seems to have got worse.
Any ideas? Thanks.