So is it legal or illegal? Web scraping and crawling aren’t illegal by themselves . After all, you could scrape or crawl your own website, without a hitch. Startups love it because it’s a cheap and powerful way to gather data without the need for partnerships.