Web Scraping
The cluster focuses on discussions about web scraping techniques, tools, services, and comparisons to APIs for extracting data from websites, including inquiries about specific scrapers, open-source options, and avoiding blocks.
Activity Over Time
Top Contributors
Keywords
Sample Comments
ugh, back to scraping / web crawling I suppose..
Hit me up, email in profile.Working on similar stuff, effectively what you have without the requirement to maintain scrapers.
I find scraping the website useful, and, better than API. And I think it is also encouraged. Checkout /robots.txt
whats the unique value proposition of this compared to the bajillion other web scrapers out there?
Nice site, very useful. Do you scrape all your data?
Thanks! More interested in the scraper.. is it open-source? If yes, where can we download it? If not, can you write about your experience in building it?
Contract me for any web-scraping needs
seems like they are advertising a scraping service -> "Want to get the data yourself?"
Couldn't one just scrape? You don't have to use the API.
So you're... scraping Google...?