-
Lalitha Kreka became a registered member a year ago
-
Dyson Baldo replied to the discussion How can I scrape product data from Lazada Thailand using Python n BeautifulSoup? in the forum General Web Scraping a year ago
How can I scrape product data from Lazada Thailand using Python n BeautifulSoup?
BeautifulSoup and requests together make for a powerful scraping combination, especially for sites like Lazada Thailand that display a lot of product data on each page. If the page you are scraping is not fully dynamic, you can use BeautifulSoup to extract the names and prices directly. One trick is to handle pagination, which allows you to…
-
Dyson Baldo replied to the discussion How to build a Wayfair price tracker using Python and BeautifulSoup? in the forum General Web Scraping a year ago
How to build a Wayfair price tracker using Python and BeautifulSoup?
To handle structural changes, I use flexible selectors and regularly test the scraper to adapt to updates in Wayfair’s HTML layout.
-
Dyson Baldo started the discussion Scrape product name, discount, and shipping from Submarino Brazil using Node.js? in the forum General Web Scraping a year ago
Scrape product name, discount, and shipping from Submarino Brazil using Node.js?
To scrape the product name from Submarino Brazil, you can use Cheerio in Node.js to extract the text from the div or span containing the product title. This is often wrapped in specific classes that you can target using Cheerio’s $(‘.class-name’) syntax. After fetching the page using axios, parse the HTML and extract the product name.
const axios…
-
Dyson Baldo changed their photo a year ago
-
Dyson Baldo became a registered member a year ago
-
Prashant Sanjiv replied to the discussion How can I scrape product reviews from Shopee Thailand using Node.js n Puppeteer? in the forum General Web Scraping a year ago
How can I scrape product reviews from Shopee Thailand using Node.js n Puppeteer?
When scraping Shopee Thailand, product reviews can be accessed by navigating through the product page and extracting review data. Puppeteer allows you to emulate user actions like scrolling, ensuring that all reviews load before extracting them. You can gather product ratings and user comments by targeting the right classes and using…
-
Prashant Sanjiv replied to the discussion How to send a JSON POST request using cURL? in the forum General Web Scraping a year ago
How to send a JSON POST request using cURL?
Using the –retry option in cURL helps manage temporary network failures by retrying the request automatically after a delay.
-
Prashant Sanjiv started the discussion Scrape product description, images, and seller information -Americanas Brazil? in the forum General Web Scraping a year ago
Scrape product description, images, and seller information -Americanas Brazil?
To scrape the product description from Americanas Brazil, you can use Selenium with Python to load the page and extract the text. The description is usually within a div or span with a specific class. After navigating to the product page, you can use find_element_by_xpath() or find_element_by_css_selector() to locate and extract the…
-
Prashant Sanjiv changed their photo a year ago
- Load More