-
Humaira Danial started the discussion How can I scrape product data from Lazada Thailand using Python n BeautifulSoup? in the forum General Web Scraping a year ago
How can I scrape product data from Lazada Thailand using Python n BeautifulSoup?
When scraping Lazada Thailand, one of the key things to remember is to deal with dynamic content. While BeautifulSoup is great for parsing HTML, you’ll often need to combine it with requests to fetch the static HTML. However, when the data is rendered by JavaScript, you may need to use something like Selenium for full functionality. For now,…
-
Humaira Danial changed their photo a year ago
-
Humaira Danial became a registered member a year ago
-
Adil Linza replied to the discussion How to convert cURL commands to Python requests? in the forum General Web Scraping a year ago
Reply to How to convert cURL commands to Python requests?
Using a database like MySQL allows me to store and analyze price data over time, enabling detailed comparisons across different e-commerce platforms.
-
Adil Linza replied to the discussion How to scrape movie details from Viooz.ac using JavaScript and Puppeteer? in the forum General Web Scraping a year ago
Reply to How to scrape movie details from Viooz.ac using JavaScript and Puppeteer?
Adding a logging mechanism helps identify when the bot encounters issues, such as missing elements or changes in the website’s structure.
-
Adil Linza started the discussion How to build a Wayfair price tracker using Python and BeautifulSoup? in the forum General Web Scraping a year ago
How to build a Wayfair price tracker using Python and BeautifulSoup?
Building a Wayfair price tracker can help monitor product price changes over time for personal or analytical purposes. Python’s BeautifulSoup library is well-suited for scraping static content, such as product titles, prices, and URLs. If Wayfair uses dynamic JavaScript to load content, Selenium can be used to render the page fully before…
-
Adil Linza changed their photo a year ago
-
Adil Linza became a registered member a year ago
-
Olga Silvester replied to the discussion What are the differences between wget and curl for web scraping? in the forum General Web Scraping a year ago
Reply to What are the differences between wget and curl for web scraping?
For dynamic websites, I rely on Selenium to load JavaScript content and scrape prices. It’s slower than BeautifulSoup but handles complex layouts well.
-
Olga Silvester replied to the discussion How to scrape movie titles and links on YesMovies.org (unblocked) using Python? in the forum General Web Scraping a year ago
Reply to How to scrape movie titles and links on YesMovies.org (unblocked) using Python?
I regularly update the bot by testing it on the target websites. Using flexible selectors, like XPath based on attributes, makes the bot adaptable to minor changes.
- Load More
