News Feed › Forums › General Web Scraping › What’s the best way to scrape Yahoo! Shopping Japan using Node.js?

  • General Web Scraping

    What’s the best way to scrape Yahoo! Shopping Japan using Node.js?

    Posted by Amatus Marlyn on 11/18/2024 at 9:26 am

    Using Puppeteer with Node.js is effective for scraping Yahoo! Shopping Japan’s dynamic content, as it allows full page rendering and DOM interaction.

    Paula Mirjam replied 1 week, 3 days ago 3 Members · 2 Replies
  • 2 Replies

  • Lulit Sharada

    Member
    12/09/2024 at 7:34 am

    Axios or Fetch can be used for JSON data retrieval, especially if network requests expose structured product data.

  • Paula Mirjam

    Member
    12/12/2024 at 12:17 pm
    • Rotating IPs and user-agent strings in each request minimizes detection and helps bypass Yahoo! Shopping Japan’s anti-scraping measures.

Log in to reply.

Start of Discussion
0 of 0 replies June 2018
Now

Report

Harassment or bullying behavior
Contains mature or sensitive content
Contains misleading or false information
Contains abusive or derogatory content
Contains spam, fake content or potential malware

Block Member?

Please confirm you want to block this member.

You will no longer be able to:

  • See blocked member's posts
  • Mention this member in posts
  • Message this member
  • Add this member as a connection

Please note: This action will also remove this member from your connections and send a report to the site admin. Please allow a few minutes for this process to complete.

Report

You have already reported this .