-
Bandile Aadan became a registered member a year ago
-
Lubanzi Tafadzwa replied to the discussion Scraping with BeautifulSoup vs. Scrapy: Which one should I choose? in the forum General Web Scraping a year ago
Reply to Scraping with BeautifulSoup vs. Scrapy: Which one should I choose?
Scrapy is faster for crawling multiple pages because it’s asynchronous.
-
Lubanzi Tafadzwa started the discussion What’s the best Python library for web scraping in 2024? in the forum General Web Scraping a year ago
What’s the best Python library for web scraping in 2024?
BeautifulSoup is still the go-to for many. It’s lightweight, easy to use, and works well for static pages.
-
Lubanzi Tafadzwa changed their photo a year ago
-
Lubanzi Tafadzwa became a registered member a year ago
-
Maxi Eike started the discussion How do I scrape real-time data from stock market websites? in the forum General Web Scraping a year ago
How do I scrape real-time data from stock market websites?
Use APIs like Alpha Vantage or Yahoo Finance if they are available instead of scraping directly.
-
Maxi Eike changed their photo a year ago
-
Maxi Eike became a registered member a year ago
-
Akram Ndidi started the discussion Best practices for web scraping to avoid getting blocked by websites. in the forum General Web Scraping a year ago
Best practices for web scraping to avoid getting blocked by websites.
Rotate IP addresses using proxies so that you don’t flood the site with too many requests from one location.
-
Akram Ndidi changed their photo a year ago
- Load More
