It’s a gray area—many people scrape, but you could still get blocked or face legal action if the site owner notices.

Scrapy’s pagination support is helpful if you’re using that framework. It can auto-detect pagination links based on your rules, which reduces custom coding, and it stops when no next link is found.