Best way to sync log files with Helpdesk system
by dalacor from LinuxQuestions.org on (#55SR1)
I have a helpdesk system that my clients use to log Ticket Requests etc.
I would like to use this Helpdesk System to view the log files such as the firewall Log file. The idea behind it is to filter the information to only upload the information that we actually want to view, but also enable us to categorise information into filters such as blocked or allowed etc.
One of the log files grows to about 1GB over a 12 month period.
So we have decided to use log rotation and rotate this log file weekly. The plan is to sync the file every hour to a folder location on our helpdesk server and rotate log file, daily or weekly to prevent huge log file sizes on our helpdesk server.
The problem that I can foresee is that any data saved in the file after last sync and before log rotation is lost. Unless there is a way to force sync before log rotate.
Secondly, I don't know if people would recommend rsync or ftp etc to transfer the log file to our helpdesk server. We are thinking rsync to only sync the changes.
The reason we have decided not to read the log file on the Linux system from our helpdesk system is because we want to create digests of a lot of the information otherwise the helpdesk system will just have way too much information. Also as the log file needs to be rotated, just simply reading from the log file won't work as all the data previously read in, would be deleted if a new log file replaces the old one.
Has anyone done anything similar where you view your log files on a CRM System to enable you to analyse, filter and categorise the data?
I would like to use this Helpdesk System to view the log files such as the firewall Log file. The idea behind it is to filter the information to only upload the information that we actually want to view, but also enable us to categorise information into filters such as blocked or allowed etc.
One of the log files grows to about 1GB over a 12 month period.
So we have decided to use log rotation and rotate this log file weekly. The plan is to sync the file every hour to a folder location on our helpdesk server and rotate log file, daily or weekly to prevent huge log file sizes on our helpdesk server.
The problem that I can foresee is that any data saved in the file after last sync and before log rotation is lost. Unless there is a way to force sync before log rotate.
Secondly, I don't know if people would recommend rsync or ftp etc to transfer the log file to our helpdesk server. We are thinking rsync to only sync the changes.
The reason we have decided not to read the log file on the Linux system from our helpdesk system is because we want to create digests of a lot of the information otherwise the helpdesk system will just have way too much information. Also as the log file needs to be rotated, just simply reading from the log file won't work as all the data previously read in, would be deleted if a new log file replaces the old one.
Has anyone done anything similar where you view your log files on a CRM System to enable you to analyse, filter and categorise the data?