• Blog
  • All Scraping Projects
  • Forums
  • Rayobyte University
  • Sign In
  • Sign Up
  • Products
  • News Feed
  • Members
  • Forums
  • Rayobyte University
    Sign in Sign up
    • Blog
    • All Scraping Projects
    • Forums
    • Rayobyte University
    • Sign In
    • Sign Up
    cover image
    Profile photo of Headley Corrie
    @HeadleyCorrie

    Headley Corrie

    Outside of my professional life, I have a deep passion for exploring cities.
    United Kingdom
    Joined Nov 2024

    Remove Connection

    Are you sure you want to remove from your connections?

    Cancel Confirm
    • About
    • Timeline
    • Blog
    • Scraping Projects
    • Connections
    • Discussions
    • Profile photo of Headley Corrie

      Headley Corrie replied to the discussion What techniques can I use to scrape real-time web chats or comment sections? in the forum General Web Scraping 9 months ago

      9 months ago

      Reply to What techniques can I use to scrape real-time web chats or comment sections?

      Puppeteer and Playwright can simulate scrolling or clicking on “load more” buttons to capture all messages in longer comment threads.

    • Profile photo of Headley Corrie

      Headley Corrie replied to the discussion What are the best practices for scraping financial data from news or stock site? in the forum General Web Scraping 9 months ago

      9 months ago

      Reply to What are the best practices for scraping financial data from news or stock site?

      I automate pagination and set delays to avoid hitting rate limits, which is especially important on sites that monitor frequent requests.

    • Profile photo of Headley Corrie

      Headley Corrie replied to the discussion How do I approach scraping data that appears only on hover or in tooltips? in the forum General Web Scraping 9 months ago

      9 months ago

      Reply to How do I approach scraping data that appears only on hover or in tooltips?

      Some tooltips are loaded as separate AJAX requests, so inspecting network requests while hovering often reveals endpoints for the data.

    • Profile photo of Headley Corrie

      Headley Corrie replied to the discussion How can I scrape structured data from sites without standard HTML tags? in the forum General Web Scraping 9 months ago

      9 months ago

      Reply to How can I scrape structured data from sites without standard HTML tags?

      Regular expressions can sometimes capture patterns within unconventional tags, though it’s less reliable for deeply nested data.

    • Profile photo of Headley Corrie

      Headley Corrie started the discussion How to track product variations like size or color on e-commerce platforms? in the forum General Web Scraping 9 months ago

      9 months ago

      How to track product variations like size or color on e-commerce platforms?

      For sites like Amazon, I capture product variations by scraping dropdown menus or variant selection fields to pull options for size, color, etc.

    • Profile photo of Headley Corrie

      Headley Corrie changed their photo 9 months ago

      9 months ago

      0 Comments
    • Profile photo of Headley Corrie

      Headley Corrie became a registered member 9 months ago

      9 months ago

      0 Comments

      Profile photo of

      Latest updates

      Profile photo of jennifer james

      jennifer james posted an update 5 months ago

      Profile photo of dali

      dali posted an update 8 months ago

      Profile photo of yew

      yew posted an update 8 months ago

      © 2025 - Rayobyte Community

      Report

      There was a problem reporting this post.

      Harassment or bullying behavior
      Contains mature or sensitive content
      Contains misleading or false information
      Contains abusive or derogatory content
      Contains spam, fake content or potential malware

      Block Member?

      Please confirm you want to block this member.

      You will no longer be able to:

      • See blocked member's posts
      • Mention this member in posts
      • Message this member
      • Add this member as a connection

      Please note: This action will also remove this member from your connections and send a report to the site admin. Please allow a few minutes for this process to complete.

      Report

      You have already reported this .