Dog Cow wrote:I can see how that would work for generic bots, and even I have measures put in-place to stop mindless bots, but if I (or anyone else) has decided to specifically scrape your site, then we are going to write a specialized bot just for the purpose (if we're serious about it, that is).
That's only one example and the most common one. There are of course many other things you can do to prevent scraping especially if you have root access. Ultimately you could get a site but it would be a lot of work if someone was trying to prevent it.
“Results! Why, man, I have gotten a lot of results! I have found several thousand things that won’t work.”
Attributed - Thomas Edison