News Feed Forums General Web Scraping How can I scrape data from a site that uses AJAX to load content?

  • How can I scrape data from a site that uses AJAX to load content?

    Posted by Maria Vasia on 11/01/2024 at 2:59 am

    Monitor the network traffic using developer tools to find the API call that the AJAX request is making.

    Amondi Mathis replied 1 week, 6 days ago 3 Members · 2 Replies
  • 2 Replies
  • Aarthi Basheer

    Member
    11/09/2024 at 5:07 am

    Use Selenium or Playwright to render the page and trigger the AJAX requests dynamically.

  • Amondi Mathis

    Member
    11/09/2024 at 5:36 am

    Sometimes, you can replicate the AJAX request directly using requests in Python.

Log in to reply.