Web Scraping Fridays: Difference between revisions
From HacDC Wiki
Mike Chelen (talk | contribs) (→Examples: foo) |
Mike Chelen (talk | contribs) (→Examples: foo) |
||
| Line 6: | Line 6: | ||
= Examples = | = Examples = | ||
< | <code> | ||
for each in `cat ../search\?q\=%7B%22source%22%3A%22legislation%22%2C%22congress%22%3A%22114%22%7D\&pageSize\=250 | sed -n "s/.*H\.R\.\([0-9]\{1,\}\).*/\1/p"`; do { wget https://www.congress.gov/bill/114th-congress/house-bill/$each; } done; | for each in `cat ../search\?q\=%7B%22source%22%3A%22legislation%22%2C%22congress%22%3A%22114%22%7D\&pageSize\=250 | sed -n "s/.*H\.R\.\([0-9]\{1,\}\).*/\1/p"`; do { wget https://www.congress.gov/bill/114th-congress/house-bill/$each; } done; | ||
</ | </code> | ||
= Resources = | = Resources = | ||
Revision as of 01:24, 18 July 2015
CFAA
Tools
Picking Victims
Examples
for each in `cat ../search\?q\=%7B%22source%22%3A%22legislation%22%2C%22congress%22%3A%22114%22%7D\&pageSize\=250 | sed -n "s/.*H\.R\.\([0-9]\{1,\}\).*/\1/p"`; do { wget https://www.congress.gov/bill/114th-congress/house-bill/$each; } done;