Zahir Xiu
-
Zahir Xiu posted a new post. 7 weeks ago
Scraping PSE.com.ph with Java MongoDB: Extracting Stock Prices, Market Trends, and Company Data for Financial InsightsLearn to scrape PSE.com.ph using Java & MongoDB to extract stock prices, market trends, and company data for valuable financial insights.
-
Zahir Xiu replied to the discussion What are the best methods for scraping data from dynamically-loaded websites? in the forum General Web Scraping 4 months ago
Reply to What are the best methods for scraping data from dynamically-loaded websites?
-
Sometimes, inspecting the network activity in dev tools can reveal a JSON API endpoint that loads the data, allowing you to directly query that endpoint instead of scraping rendered content.
-
-
Zahir Xiu started the discussion How can I optimize my scraping code for faster performance? in the forum General Web Scraping 4 months ago
How can I optimize my scraping code for faster performance?
Multithreading is a big help. Using libraries like Concurrent Futures or asyncio in Python allows me to run multiple requests simultaneously, which speeds up scraping significantly.
-
Zahir Xiu changed their photo 4 months ago
-
Zahir Xiu became a registered member 4 months ago
