Slackware --Current - Kernel-headers updates - Dumb Question

This is likely a dumb question, but hey what's one more ;)

I've elected to temporarily stay on the 5.4.84 kernel due to stability issues with 5.10

I do periodically try the updated kernels but so far usually end up dropping back down after a day or two

Anyway my question is this:

Using the 5.4.84 kernel, should I be upgrading to the current kernel-headers?
(kernel-headers-5.10.17-x86-1.txz) or should I be using 5.4.84 kernel-headers

Or does it not matter eitherway