My general attitude towards web scraping is that if I, as a user, have access to a piece of data through a web browser, the site owners have no grounds to object to me using a different program to access the data, as long as I’m not putting more load on their servers than a user clicking all the links would.
Obviously, there may be legal repercussions for scraping, and you should follow such laws, but those laws seem absurd to me.
Obviously, there may be legal repercussions for scraping, and you should follow such laws, but those laws seem absurd to me.