-
Abioye Sparrow became a registered member a year ago
-
Lawan Intira replied to the discussion How can I scrape data from dynamically loaded JavaScript content? in the forum General Web Scraping a year ago
Reply to How can I scrape data from dynamically loaded JavaScript content?
Another approach is to look at the network requests via your browser’s dev tools and try to directly query the API the website is using.
-
Lawan Intira started the discussion Web scraping with Golang vs. Python: Which is more efficient? in the forum General Web Scraping a year ago
Web scraping with Golang vs. Python: Which is more efficient?
Golang is more efficient for large-scale scraping because it’s faster and uses less memory.
-
Lawan Intira changed their photo a year ago
-
Lawan Intira became a registered member a year ago
-
Kanchana Lalita replied to the discussion How do you handle pagination when scraping websites? in the forum General Web Scraping a year ago
Reply to How do you handle pagination when scraping websites?
If the page uses infinite scrolling, Selenium or Playwright can simulate scrolling.
-
Kanchana Lalita started the discussion How to scrape data from a website using Node.js and Puppeteer? in the forum General Web Scraping a year ago
How to scrape data from a website using Node.js and Puppeteer?
Set up Puppeteer and use it to open a browser page and interact with the website just like a real user.
-
Kanchana Lalita changed their photo a year ago
-
Kanchana Lalita became a registered member a year ago
-
Nora Rhys replied to the discussion How do you handle pagination when scraping websites? in the forum General Web Scraping a year ago
Reply to How do you handle pagination when scraping websites?
For sites using AJAX to load more content, monitor the network tab for API calls and replicate them.
- Load More
