-
Eratosthenes Madita replied to the discussion How to scrape movie names and release dates from TamilMV using Python? in the forum General Web Scraping a year ago
Reply to How to scrape movie names and release dates from TamilMV using Python?
To avoid triggering anti-scraping measures, I implement randomized delays between requests and rotate user-agent strings for each session.
-
Nere Lucille replied to the discussion How do I scrape mortgage rate data from financial sites? in the forum General Web Scraping a year ago
Reply to How do I scrape mortgage rate data from financial sites?
-
By storing data on 30-year, 15-year, and adjustable-rate mortgages, I build a complete dataset for mortgage rate analysis.
-
-
Eratosthenes Madita started the discussion How to extract random IP addresses from an online dataset using Go? in the forum General Web Scraping a year ago
How to extract random IP addresses from an online dataset using Go?
Extracting random IP addresses from an online dataset can be useful for network testing or analysis. Go’s lightweight concurrency model and the Colly library make it an excellent choice for efficiently scraping structured datasets. Start by inspecting the website to locate the IP addresses, often found in tables or lists. If the dataset is…
-
Nere Lucille replied to the discussion How can I gather SEO data by scraping Google Search results? in the forum General Web Scraping a year ago
Reply to How can I gather SEO data by scraping Google Search results?
Google’s Custom Search JSON API allows access to SERP data legally, which I use for structured and reliable SEO data.
-
Nere Lucille changed their photo a year ago
-
Nere Lucille became a registered member a year ago
-
Eratosthenes Madita changed their photo a year ago
-
Ilham Donnie replied to the discussion How can I scrape promotional offers and discounts on Grab? in the forum General Web Scraping a year ago
Reply to How can I scrape promotional offers and discounts on Grab?
-
Scheduling scrapes during promotional events, like Grab’s birthday or holiday sales, ensures I capture the most relevant discounts.
-
-
Ilham Donnie replied to the discussion What’s the best way to gather Shopify product data if business allows scraping? in the forum General Web Scraping a year ago
Reply to What’s the best way to gather Shopify product data if business allows scraping?
If the store’s API isn’t open, I scrape only publicly available information, like product descriptions and prices, to respect their terms.
-
Ilham Donnie replied to the discussion How can I use Java to scrape product information on Carrefour’s European site? in the forum General Web Scraping a year ago
Reply to How can I use Java to scrape product information on Carrefour’s European site?
-
For dynamic content, integrate Selenium with Java to fully render pages, enabling you to scrape updated product data accurately.
-
- Load More
