Humaira Danial
-
Humaira Danial posted a new post. 7 months ago
Scraping Qoo10.sg via Ruby SQLite: Extracting Product PricesLearn how to scrape Qoo10.sg for product prices using Ruby and SQLite. Extract, store, and analyze data efficiently with this step-by-step guide.
-
Humaira Danial replied to the discussion How to download files from a website using cURL in PHP? in the forum General Web Scraping 9 months ago
Reply to How to download files from a website using cURL in PHP?
For APIs requiring authentication, I use OAuth or API tokens, securely storing them in environment variables to avoid hardcoding sensitive data.
-
Humaira Danial replied to the discussion What are the differences between wget and curl for web scraping? in the forum General Web Scraping 9 months ago
Reply to What are the differences between wget and curl for web scraping?
To manage rate limits, I implement delays between API requests or use a rate limiter library to ensure I stay within the allowed request quota.
-
Humaira Danial started the discussion How can I scrape product data from Lazada Thailand using Python n BeautifulSoup? in the forum General Web Scraping 9 months ago
How can I scrape product data from Lazada Thailand using Python n BeautifulSoup?
When scraping Lazada Thailand, one of the key things to remember is to deal with dynamic content. While BeautifulSoup is great for parsing HTML, you’ll often need to combine it with requests to fetch the static HTML. However, when the data is rendered by JavaScript, you may need to use something like Selenium for full functionality. For now,…
-
Humaira Danial changed their photo 9 months ago
-
Humaira Danial became a registered member 9 months ago
