-
Sunil Eliina became a registered member a year ago
-
Heledd Neha replied to the discussion Which is better: Go or Node.js for scraping hotel prices from Agoda? in the forum General Web Scraping a year ago
Reply to Which is better: Go or Node.js for scraping hotel prices from Agoda?
Go’s concurrency model allows for scraping multiple pages simultaneously with minimal resource usage, making it a great option for large-scale scraping projects.
-
Heledd Neha replied to the discussion How does web scraping work using Python and BeautifulSoup? in the forum General Web Scraping a year ago
Reply to How does web scraping work using Python and BeautifulSoup?
Pagination is another tricky part. I usually look for the “Next Page” button, extract its link, and loop through all the pages to get the complete dataset.
-
Heledd Neha started the discussion How to scrape restaurant data from DoorDash.com using Python? in the forum General Web Scraping a year ago
How to scrape restaurant data from DoorDash.com using Python?
Scraping restaurant data from DoorDash.com using Python can provide insights into menu items, prices, and restaurant names. Python’s requests library can fetch page content, while BeautifulSoup parses the HTML to extract relevant information. This script demonstrates how to gather restaurant names and menu item prices from DoorDash.
import…
-
Heledd Neha changed their photo a year ago
-
Heledd Neha became a registered member a year ago
-
Rhea Erika replied to the discussion How to scrape news headlines from a news aggregator website? in the forum General Web Scraping a year ago
Reply to How to scrape news headlines from a news aggregator website?
One way I deal with frequent website changes is by building a flexible scraper that uses CSS selectors instead of hardcoding tags or classes. This approach ensures the scraper is easier to update when the website layout changes.
-
Rhea Erika replied to the discussion How do you scrape flight information from airline websites? in the forum General Web Scraping a year ago
Reply to How do you scrape flight information from airline websites?
To handle unexpected changes, I use dynamic XPaths instead of fixed ones. This makes the scraper more adaptable to slight layout changes without requiring constant updates.
-
Rhea Erika started the discussion How can I extract meal kit prices from HelloFresh.com using JavaScript? in the forum General Web Scraping a year ago
How can I extract meal kit prices from HelloFresh.com using JavaScript?
Scraping meal kit prices from HelloFresh.com using JavaScript allows you to collect data such as meal kit names, prices, and serving sizes. Using Node.js with Puppeteer, you can handle dynamic content rendering and automate browser interactions to extract relevant details. Below is a sample script for scraping meal kits from…
-
Rhea Erika changed their photo a year ago
- Load More
