-
Eratosthenes Madita became a registered member a year ago
-
Ilham Donnie replied to the discussion How can I use Node.js to scrape product reviews on Bol.com? in the forum General Web Scraping a year ago
Reply to How can I use Node.js to scrape product reviews on Bol.com?
-
For extracting reviews, focus on HTML tags associated with user feedback, like .review-text and .rating-stars, to ensure accuracy.
-
-
Ilham Donnie replied to the discussion What are some efficient ways to scrape Real.de’s marketplace data with Golang? in the forum General Web Scraping a year ago
Reply to What are some efficient ways to scrape Real.de’s marketplace data with Golang?
For dynamically loaded data, Chromedp in Go is ideal, allowing for headless browsing and capturing elements like reviews and availability.
-
Ilham Donnie replied to the discussion What are the top techniques for scraping the MediaMarkt site using PHP? in the forum General Web Scraping a year ago
Reply to What are the top techniques for scraping the MediaMarkt site using PHP?
-
Use PHP with headless Chrome through the symfony/panther package to handle MediaMarkt’s dynamically loaded product listings.
-
-
Ilham Donnie replied to the discussion What’s the most effective way to extract limited-time offers on Amazon? in the forum General Web Scraping a year ago
Reply to What’s the most effective way to extract limited-time offers on Amazon?
Setting my scraper to run periodically during peak sale times, like Black Friday or Prime Day, lets me capture the most relevant deals.
-
Ilham Donnie replied to the discussion What’s the best way to scrape product pages on Decathlon with Ruby? in the forum General Web Scraping a year ago
Reply to What’s the best way to scrape product pages on Decathlon with Ruby?
-
For dynamically loaded elements like availability or reviews, combine Nokogiri with Watir, a Ruby browser automation tool, to render content.
-
-
Ramlah Koronis Koronis replied to the discussion Scraping job postings and locations using Ruby and Nokogiri in the forum General Web Scraping a year ago
Reply to Scraping job postings and locations using Ruby and Nokogiri
Saving the scraped data in a database like PostgreSQL allows me to analyze job trends or filter by location and industry efficiently.
-
Ramlah Koronis Koronis replied to the discussion Extracting flight schedules and routes with Python and aiohttp in the forum General Web Scraping a year ago
Reply to Extracting flight schedules and routes with Python and aiohttp
For dynamic content, I use Capybara with Selenium, which allows interacting with elements like dropdowns or infinite scrolling job lists.
-
Ilham Donnie replied to the discussion What’s the best way to scrape restaurant reviews and ratings on GrabFood? in the forum General Web Scraping a year ago
Reply to What’s the best way to scrape restaurant reviews and ratings on GrabFood?
-
Rotating IP addresses helps avoid detection, especially when accessing popular restaurant listings with high review volumes.
-
-
Ramlah Koronis Koronis started the discussion How to scrape movie names and release dates from TamilMV using Python? in the forum General Web Scraping a year ago
How to scrape movie names and release dates from TamilMV using Python?
Scraping movie names and release dates from TamilMV requires careful handling since the website may have anti-scraping measures in place. Python’s BeautifulSoup library can help extract data from static pages. For dynamic content loaded with JavaScript, Selenium or Playwright is better suited. Inspect the HTML structure to identify the classes…
- Load More
