-
Claudius Rebeka replied to the discussion How can I handle data extraction from websites with region-specific restriction? in the forum General Web Scraping a year ago
Reply to How can I handle data extraction from websites with region-specific restriction?
In some cases, switching to a local version of the site’s domain (like .fr for France) can reveal region-specific content without proxies.
-
Claudius Rebeka started the discussion Best practices for scraping travel data from Agoda or Traveloka? in the forum General Web Scraping a year ago
Best practices for scraping travel data from Agoda or Traveloka?
Traveloka and Agoda often use APIs for bookings, so if available, I rely on the API for structured data on hotel prices and availability.
-
Claudius Rebeka changed their photo a year ago
-
Claudius Rebeka became a registered member a year ago
-
Iphigenia Patricius replied to the discussion How do I approach scraping data that appears only on hover or in tooltips? in the forum General Web Scraping a year ago
Reply to How do I approach scraping data that appears only on hover or in tooltips?
Some sites hide tooltip content in hidden divs. Uncovering these elements with JavaScript before scraping works in cases where data is preloaded.
-
Iphigenia Patricius replied to the discussion How do I handle sites that block based on unusual request patterns? in the forum General Web Scraping a year ago
Reply to How do I handle sites that block based on unusual request patterns?
Implementing random paths and varying click order can make the interaction flow look less automated, which reduces detection chances.
-
Iphigenia Patricius replied to the discussion How do I extract text from images or infographics? in the forum General Web Scraping a year ago
Reply to How do I extract text from images or infographics?
Combining OCR with template matching helps detect and pull text from specific areas, like headers or labels in charts.
-
Iphigenia Patricius replied to the discussion How can I handle data extraction from websites with region-specific restriction? in the forum General Web Scraping a year ago
Reply to How can I handle data extraction from websites with region-specific restriction?
Using local language headers and user-agent strings for specific countries helps the scraper appear more genuine, reducing blocks.
-
Iphigenia Patricius started the discussion How to track electronics trends on Shopee and Lazada in Asia? in the forum General Web Scraping a year ago
How to track electronics trends on Shopee and Lazada in Asia?
Both Shopee and Lazada have categories dedicated to gadgets, so I set up targeted scrapes for sections like mobile phones, wearables, and accessories.
-
Iphigenia Patricius changed their photo a year ago
- Load More
