Rilla Anahita
-
Rilla Anahita replied to the discussion How to convert cURL commands to Python requests? in the forum General Web Scraping 8 months ago
Reply to How to convert cURL commands to Python requests?
For dynamic content, I use Puppeteer’s waitForSelector method to ensure all results are loaded before extracting data. This avoids missing partial information.
-
Rilla Anahita replied to the discussion How to scrape movie names and release dates from TamilMV using Python? in the forum General Web Scraping 8 months ago
Reply to How to scrape movie names and release dates from TamilMV using Python?
To avoid detection, I rotate proxies and user-agent strings for each session. This helps prevent IP bans and ensures smooth operation over time.
-
Rilla Anahita started the discussion What are the differences between wget and curl for web scraping? in the forum General Web Scraping 8 months ago
What are the differences between wget and curl for web scraping?
Both wget and curl are popular command-line tools used for making HTTP requests and downloading data from websites. However, they differ in terms of features, use cases, and flexibility. wget is designed primarily for downloading files and supports recursive downloads, making it ideal for mirroring websites or downloading large datasets. On…
-
Rilla Anahita changed their photo 8 months ago
-
Rilla Anahita became a registered member 8 months ago
