

Bandile Aadan
-
Bandile Aadan replied to the discussion Best practices for web scraping to avoid getting blocked by websites. in the forum General Web Scraping 10 months ago
Best practices for web scraping to avoid getting blocked by websites.
Add delays between requests to mimic human behavior—around 1-2 seconds usually works.
-
Bandile Aadan started the discussion Legal considerations and ethics of web scraping: What are the boundaries? in the forum General Web Scraping 10 months ago
Legal considerations and ethics of web scraping: What are the boundaries?
Scraping publicly available data is usually fine, but make sure to respect robots.txt rules.
-
Bandile Aadan changed their photo 10 months ago
-
Bandile Aadan became a registered member 10 months ago