News Feed Forums General Web Scraping How can I automate data scraping from e-commerce sites like Amazon?

  • Sandhya Lockie

    Member
    11/09/2024 at 8:38 am

    You could try Selenium or Playwright for dynamically loaded content, but be aware that Amazon has strong anti-bot measures.

  • Lara Calanthe

    Member
    11/11/2024 at 6:27 am

    Consider using Amazon’s Product Advertising API—it’s more legal and stable than scraping directly.

  • Dado Nura

    Member
    11/11/2024 at 7:55 am

    You’ll need a good strategy for bypassing captchas and throttling, especially when dealing with Amazon’s advanced anti-bot protections.

  • Eudocia Antonis

    Member
    11/11/2024 at 8:08 am

    If you want to avoid legal issues, stick to scraping only publicly accessible data and respect Amazon’s terms of service.

  • Eliza Naeema

    Member
    11/11/2024 at 8:18 am

    Automating requests and using multiple IP addresses with a service like CrawlBot might help reduce blocks.

Log in to reply.