[SOLVED] [wget] Display output with "-i" option?
by littlebigman from LinuxQuestions.org on (#6CT4A)
Hello,
For basic web crawling, I'd like to feed wget a list of URLs, and then massage the data with grep + sed.
It works fine with a single URL, but I get no output on the screen when calling it with a list of URLs (-i switch):
Code:wget -i list.txt -qO - | grep -Poha "some_pattern" | sed -r "s@some_pattern@\1 \2@"Is there a work-around?
Thank you.
For basic web crawling, I'd like to feed wget a list of URLs, and then massage the data with grep + sed.
It works fine with a single URL, but I get no output on the screen when calling it with a list of URLs (-i switch):
Code:wget -i list.txt -qO - | grep -Poha "some_pattern" | sed -r "s@some_pattern@\1 \2@"Is there a work-around?
Thank you.