Network problems under high load which causes high CPU usage in processes using network
by arivo from LinuxQuestions.org on (#5N1E2)
Hello,
we found a very strange problem. We are running Neural Networks on images from cameras on our Intel NUCs and also have some communication with other PCs and to our servers.
When processing too many images the NUC becomes too hot and starts to reduce the CPU clock and there the strange behavior starts. In this state we get network disconnects and other network problems, though the high workload is mainly because of the GPU and to a lesser extend the CPU. And while other processes continue normally (only slightly higher CPU usage), processes using the network start to use much more CPU (a service which only forwards messages from and to another PC suddenly uses 30% CPU instead of 3% in normal circumstances).
Does anyone know why the high workload has such an impact on the network communication? And is there something we can do to reduce the problem?
Thanks,
Thomas
we found a very strange problem. We are running Neural Networks on images from cameras on our Intel NUCs and also have some communication with other PCs and to our servers.
When processing too many images the NUC becomes too hot and starts to reduce the CPU clock and there the strange behavior starts. In this state we get network disconnects and other network problems, though the high workload is mainly because of the GPU and to a lesser extend the CPU. And while other processes continue normally (only slightly higher CPU usage), processes using the network start to use much more CPU (a service which only forwards messages from and to another PC suddenly uses 30% CPU instead of 3% in normal circumstances).
Does anyone know why the high workload has such an impact on the network communication? And is there something we can do to reduce the problem?
Thanks,
Thomas