-
Eliana Yoel replied to the discussion Scrape product name, price, rating from Mercado Livre Brazil using Puppeteer? in the forum General Web Scraping a year ago
Reply to Scrape product name, price, rating from Mercado Livre Brazil using Puppeteer?
To scrape the rating from Mercado Livre Brazil, you’ll need to target the element that holds the product’s rating. Ratings are often displayed as star icons or a numeric value. You can use Puppeteer to select the span or div containing the rating and extract it once the page is fully loaded.
const puppeteer = require('puppeteer'); (async () =>…
-
Eliana Yoel started the discussion Compare Python and Node.js to scrape product reviews from Momo Taiwan in the forum General Web Scraping a year ago
Compare Python and Node.js to scrape product reviews from Momo Taiwan
What are the differences between using Python and Node.js to scrape product reviews from Momo Taiwan, a leading e-commerce platform? Does one programming language provide advantages over the other in handling dynamic content? Would Python’s BeautifulSoup and requests libraries be more efficient for parsing static HTML, while Node.js with…
-
Eliana Yoel changed their photo a year ago
-
Eliana Yoel became a registered member a year ago
-
Jochem Gunvor replied to the discussion How to fetch property data using Redfin API with Python? in the forum General Web Scraping a year ago
Reply to How to fetch property data using Redfin API with Python?
For endpoints requiring authentication, I store API keys or tokens securely in environment variables. This approach avoids exposing sensitive credentials in the source code.
-
Jochem Gunvor replied to the discussion How to scrape movie titles and links on YesMovies.org (unblocked) using Python? in the forum General Web Scraping a year ago
Reply to How to scrape movie titles and links on YesMovies.org (unblocked) using Python?
I use Selenium’s ActionChains to simulate user interactions, like mouse movements and clicks, which help avoid detection and prevent CAPTCHA challenges from appearing.
-
Jochem Gunvor started the discussion Use Node.js to scrape product titles from Books.com.tw in the forum General Web Scraping a year ago
Use Node.js to scrape product titles from Books.com.tw
How would you scrape product titles from Books.com.tw, one of Taiwan’s most popular online bookstores, considering that the site is written in Chinese? Does the presence of Chinese characters in the webpage content or attributes require additional handling? Would UTF-8 encoding be sufficient to ensure that the characters are parsed and…
-
Jochem Gunvor changed their photo a year ago
-
Jochem Gunvor became a registered member a year ago
-
Hadrianus Kazim replied to the discussion What are the differences between wget and curl for web scraping? in the forum General Web Scraping a year ago
Reply to What are the differences between wget and curl for web scraping?
When working with APIs or making requests that require custom headers, cookies, or authentication, I choose curl. Its flexibility is unmatched in such scenarios.
- Load More
