Caradog Anah
-
Caradog Anah replied to the discussion How can I detect and manage duplicate data in my scraped results? in the forum General Web Scraping 10 months ago
Reply to How can I detect and manage duplicate data in my scraped results?
Caching recent requests allows my scraper to compare new data with recent data, which reduces redundant processing.
-
Caradog Anah replied to the discussion How can I scrape multi-step verification processes? in the forum General Web Scraping 10 months ago
Reply to How can I scrape multi-step verification processes?
Where 2FA is required, I save authentication tokens to maintain access without re-verifying, within the session duration allowed.
-
Caradog Anah replied to the discussion How do I handle scraping for real-time data that updates frequently? in the forum General Web Scraping 10 months ago
Reply to How do I handle scraping for real-time data that updates frequently?
I sometimes subscribe to the site’s updates if available, then only scrape when notified of changes. This minimizes unnecessary scraping.
-
Caradog Anah started the discussion How can I scrape travel packages on TUI’s European site using Python? in the forum General Web Scraping 10 months ago
How can I scrape travel packages on TUI’s European site using Python?
Use Selenium with Python to navigate TUI’s search filters, selecting specific travel packages, destinations, and dates to scrape tailored data.
-
Caradog Anah changed their photo 10 months ago
-
Caradog Anah became a registered member 10 months ago
