-
Iphigenia Patricius became a registered member a year ago
-
Manoj Fikreta replied to the discussion How can I scrape structured data from sites without standard HTML tags? in the forum General Web Scraping a year ago
Reply to How can I scrape structured data from sites without standard HTML tags?
For sites with consistent visual patterns, using pixel-based location recognition with headless browsers helps capture data visually.
-
Manoj Fikreta replied to the discussion How do I handle sites that block based on unusual request patterns? in the forum General Web Scraping a year ago
Reply to How do I handle sites that block based on unusual request patterns?
Making fewer requests to high-risk pages, like login or profile pages, minimizes suspicion and keeps the scraper running longer.
-
Manoj Fikreta replied to the discussion How do I extract text from images or infographics? in the forum General Web Scraping a year ago
Reply to How do I extract text from images or infographics?
For infographics with repetitive layouts, I train custom OCR models to recognize and extract specific patterns more accurately.
-
Manoj Fikreta replied to the discussion How can I handle data extraction from websites with region-specific restriction? in the forum General Web Scraping a year ago
Reply to How can I handle data extraction from websites with region-specific restriction?
Automating interactions through a headless browser with geolocation settings often bypasses restrictions, especially for location-specific data.
-
Manoj Fikreta started the discussion How to gather trending product data from Shopee and Lazada in Southeast Asia? in the forum General Web Scraping a year ago
How to gather trending product data from Shopee and Lazada in Southeast Asia?
I track top-selling categories on both Shopee and Lazada to identify which items are currently trending in Southeast Asia.
-
Manoj Fikreta changed their photo a year ago
-
Manoj Fikreta became a registered member a year ago
-
Herakles Urias replied to the discussion How can I scrape embedded data from audio or video content? in the forum General Web Scraping a year ago
Reply to How can I scrape embedded data from audio or video content?
I use the open-source tool pydub to split longer audio into smaller clips, which can then be transcribed more easily.
-
Herakles Urias replied to the discussion What techniques can I use to scrape real-time web chats or comment sections? in the forum General Web Scraping a year ago
Reply to What techniques can I use to scrape real-time web chats or comment sections?
I save timestamps for each chat message, which helps organize the data chronologically and maintain the original conversation flow.
- Load More
