[SOLVED] need help filtering a very big file
by atjurhs from LinuxQuestions.org on (#6G1MF)
hey guys, i need help filtering a very big file. my file has 6 columns of data but a gazillion rows of data (so i can't open this file in LibreOffice Calc and use its filtering feature which would be really easy). many of the rows contain data i don't want and if i filter them out then i should have a manageable file. the columns i would like to filter on are columns 5 and 6, and if they don't contain the words IDK and NOPE then i would like to print that line. i think my awk filtering statement should look something like this
Code:$ awk '{
if ($5 !="IDK" || $5 != "NOPE" || $6 != NOPE= "")
print "$0 and redirect the output to a new file";
}' A_VERY_BIG_FILEwithout the redirection part it works, but i don't know how to redirect the output to a new file.
what do you think?
Code:$ awk '{
if ($5 !="IDK" || $5 != "NOPE" || $6 != NOPE= "")
print "$0 and redirect the output to a new file";
}' A_VERY_BIG_FILEwithout the redirection part it works, but i don't know how to redirect the output to a new file.
what do you think?