-
Alexius Poncio started the discussion Compare using Python and Go to scrape hotel prices from Traveloka Indonesia in the forum General Web Scraping a year ago
Compare using Python and Go to scrape hotel prices from Traveloka Indonesia
How does scraping hotel prices from Traveloka, a popular travel booking website in Indonesia, differ when using Python versus Go? Does Python’s BeautifulSoup library provide enough flexibility to handle the site’s structure, or does Go’s Colly library offer better performance for large-scale scraping tasks? How do both languages handle…
-
Alexius Poncio changed their photo a year ago
-
Alexius Poncio became a registered member a year ago
-
Heiko Nanda replied to the discussion Scrape product reviews, pricing, and categories from Currys UK with Python in the forum General Web Scraping a year ago
Reply to Scrape product reviews, pricing, and categories from Currys UK with Python
The script could also benefit from extracting additional metadata, such as product ratings or discount details. This would provide a more complete data set for analysis, especially for businesses interested in competitive pricing.
-
Heiko Nanda replied to the discussion Scrape product details, ratings, and delivery info ASOS UK using PHP and Guzzle? in the forum General Web Scraping a year ago
Reply to Scrape product details, ratings, and delivery info ASOS UK using PHP and Guzzle?
To scrape delivery information, find the section listing shipping options or delivery times, often located in a div or span tag. Use PHP with DOMXPath to extract this information.
<?php require 'vendor/autoload.php';
use GuzzleHttpClient;
// Initialize Guzzle client
$client = new Client();
$response…
-
Heiko Nanda started the discussion Compare using PHP and Node.js to scrape product ratings from ETMall Taiwan in the forum General Web Scraping a year ago
Compare using PHP and Node.js to scrape product ratings from ETMall Taiwan
How does scraping product ratings from ETMall Taiwan differ when using PHP versus Node.js? Is PHP’s DOMDocument better suited for parsing static HTML, or does Node.js with Puppeteer handle dynamic JavaScript-rendered content more effectively? Would either language provide a significant advantage when handling large-scale scraping across multiple…
-
Heiko Nanda changed their photo a year ago
-
Heiko Nanda became a registered member a year ago
-
Rayna Meinrad replied to the discussion Scrape product name, price, customer reviews from Magazine Luiza Brazil on Ruby? in the forum General Web Scraping a year ago
Reply to Scrape product name, price, customer reviews from Magazine Luiza Brazil on Ruby?
To gather customer reviews, identify the section of the page where reviews are listed, typically within div tags with specific classes. Iterate through these elements to extract individual reviews, capturing the review text and any associated metadata such as ratings.
require 'net/http' require 'nokogiri'
# Fetch the product page
url…
-
Rayna Meinrad replied to the discussion Scrape product name, discount, and shipping from Submarino Brazil using Node.js? in the forum General Web Scraping a year ago
Reply to Scrape product name, discount, and shipping from Submarino Brazil using Node.js?
To scrape shipping details from Submarino Brazil, use Cheerio to find the shipping section of the page. The shipping information, including estimated delivery times and shipping fees, is usually contained in a specific div or span. Extract this information by selecting the appropriate class or tag that holds the shipping text.
const axios…
- Load More
