News Feed

Capturing market cap and circulating supply data from these sites allows me to calculate relative value across different coins.

• Using keywords, like “best sellers” or “trending,” I target only the top items in each category, reducing the number of pages needed to scrape.

• Adding a unique identifier for each store in my data helps organize and separate information from each source in my database.

• Organizing data by book genre or product category supports comparative analysis, particularly for Dangdang’s book marketplace.

I organize flights by route, time, and fare class, enabling detailed analysis of ANA’s pricing trends across travel seasons.

I schedule scrapes during sales events, such as Lazada’s “Birthday Sale” or Shopee’s “12.12,” capturing data spikes during peak shopping periods.

• Organizing product data by category allows me to focus on specific segments, like home goods or smartphones, for more targeted analysis.