News Feed Forums General Web Scraping How can I scrape data from infinite scrolling pages (e.g., social media)?

  • How can I scrape data from infinite scrolling pages (e.g., social media)?

    Posted by Aeolus Afrodita on 10/30/2024 at 1:11 am

    Use Selenium to simulate scrolling down and loading more content dynamically.

    Zababa Keone replied 2 weeks ago 3 Members · 2 Replies
  • 2 Replies
  • Maria Vasia

    Member
    11/01/2024 at 3:01 am

    Sometimes you can access an API that fetches the new content without needing to scroll.

  • Zababa Keone

    Member
    11/08/2024 at 10:35 am

    Puppeteer works well for handling infinite scrolls by detecting when new elements load.

Log in to reply.