News Feed Forums General Web Scraping How can I scrape data from dynamically loaded JavaScript content?

  • How can I scrape data from dynamically loaded JavaScript content?

    Posted by Guillermo Sanjay on 10/23/2024 at 1:24 pm

    You should use Selenium or Playwright to simulate a browser and interact with JavaScript.

    Baldr Ted replied 5 months ago 4 Members · 3 Replies
  • 3 Replies
  • Lawan Intira

    Member
    11/06/2024 at 12:37 pm

    Another approach is to look at the network requests via your browser’s dev tools and try to directly query the API the website is using.

  • Sunil Iztok

    Member
    11/08/2024 at 4:57 am

    Puppeteer is another tool that handles dynamic content well, especially for Node.js users.

  • Baldr Ted

    Member
    11/08/2024 at 6:25 am

    You could also try to replicate the AJAX requests manually if you can find the correct API endpoints.

Log in to reply.

Start of Discussion
1 of 3 replies November 2024
Now