8 September, 201611 December, 2017bash Get url’s from website with wget wget –spider –no-check-certificate –force-html -r -l2 https://website.of.interest.com 2>&1 | grep ‘^–‘ | awk ‘{ print $3 }’ | grep -v ‘\.\(css\|js\|png\|gif\|jpg\)$’ >> […]
