-
Gurutz Tanja replied to the discussion Web scraping with Golang vs. Python: Which is more efficient? in the forum General Web Scraping a year ago
Reply to Web scraping with Golang vs. Python: Which is more efficient?
Python is easier for quick-and-dirty web scraping, especially with libraries like BeautifulSoup and Scrapy
-
Gurutz Tanja replied to the discussion How to scrape data from a website using Node.js and Puppeteer? in the forum General Web Scraping a year ago
Reply to How to scrape data from a website using Node.js and Puppeteer?
Make sure to handle page navigation, dynamic content loading, and scraping the necessary HTML elements.
-
Gurutz Tanja started the discussion How can I scrape data while maintaining user-agent rotation? in the forum General Web Scraping a year ago
How can I scrape data while maintaining user-agent rotation?
Use the fake_useragent Python library to randomly generate different user-agent headers for each request.
-
Gurutz Tanja changed their photo a year ago
-
Gurutz Tanja became a registered member a year ago
-
Kelebogile Mahendra replied to the discussion What are the benefits of using Selenium for web scraping vs. API scraping? in the forum General Web Scraping a year ago
Reply to What are the benefits of using Selenium for web scraping vs. API scraping?
Selenium can handle more complex interactions, like filling out forms and clicking buttons, which APIs can’t.
-
Kelebogile Mahendra replied to the discussion How do you scrape dynamic tables that use JavaScript on a webpage? in the forum General Web Scraping a year ago
Reply to How do you scrape dynamic tables that use JavaScript on a webpage?
Use requests-html if you need a lightweight option to scrape tables rendered by JavaScript.
-
Kelebogile Mahendra started the discussion How to scrape data from mobile-optimized websites? in the forum General Web Scraping a year ago
How to scrape data from mobile-optimized websites?
Switch the user-agent to a mobile browser version to scrape the mobile version of the site.
-
Kelebogile Mahendra changed their photo a year ago
-
Kelebogile Mahendra became a registered member a year ago
- Load More
