-
Olamilekan Chaminda became a registered member a year ago
-
Melite Stan replied to the discussion How does Python’s Flask compare to Django for web app development? in the forum General Web Scraping a year ago
Reply to How does Python’s Flask compare to Django for web app development?
Django comes with a powerful ORM and admin panel, making it easier to manage data, while Flask requires you to build these features yourself.
-
Melite Stan replied to the discussion What are the best resources for learning Rust in 2024? in the forum General Web Scraping a year ago
Reply to What are the best resources for learning Rust in 2024?
Joining the Rust subreddit or the Rust Discord server can connect you with the community for advice and project ideas.
-
Melite Stan replied to the discussion What’s the best way to learn Golang for backend development? in the forum General Web Scraping a year ago
Reply to What’s the best way to learn Golang for backend development?
Learning Go is easier if you come from a C or C++ background, but even beginners can quickly grasp its simplicity and power.
-
Melite Stan started the discussion What are the best practices for scraping financial data from news or stock site? in the forum General Web Scraping a year ago
What are the best practices for scraping financial data from news or stock site?
APIs like Alpha Vantage and Yahoo Finance are ideal for stock data, as they provide accurate, structured data without needing to scrape HTML.
-
Melite Stan changed their photo a year ago
-
Melite Stan became a registered member a year ago
-
Tasunka Meliton replied to the discussion What are the best methods for scraping data from dynamically-loaded websites? in the forum General Web Scraping a year ago
Reply to What are the best methods for scraping data from dynamically-loaded websites?
Scrapy Splash is another option for Python users. It can render JavaScript within Scrapy pipelines, allowing you to handle dynamic content without switching libraries.
rayobyte.com
What are the best methods for scraping data from dynamically-loaded websites? - Rayobyte Community
Headless browsers like Selenium or Puppeteer are ideal for handling dynamic sites. They can render JavaScript, so you can wait for content to load before
-
Tasunka Meliton replied to the discussion How can I manage session-based scraping effectively? in the forum General Web Scraping a year ago
Reply to How can I manage session-based scraping effectively?
For session-based scraping, I authenticate first and store session cookies, then pass them with each request. This maintains login state and reduces the need for re-authentication.
-
Tasunka Meliton replied to the discussion What’s the best way to handle CAPTCHAs while scraping? in the forum General Web Scraping a year ago
Reply to What’s the best way to handle CAPTCHAs while scraping?
Sometimes, changing the proxy IP can bypass CAPTCHAs. CAPTCHA triggers are often IP-based, so if you encounter one, switching IPs could get you around it.
- Load More
