-
Keone Michael replied to the discussion How to scrape data from Facebook pages or public groups? in the forum General Web Scraping a year ago
Reply to How to scrape data from Facebook pages or public groups?
Make sure you don’t scrape personal data or violate Facebook’s terms of service, as this could lead to your account being banned.
-
Keone Michael replied to the discussion How to scrape data from a site behind a paywall? in the forum General Web Scraping a year ago
Reply to How to scrape data from a site behind a paywall?
Paywalls are often illegal to scrape without permission, so the best practice is to look for APIs or subscription-based data access.
-
Keone Michael replied to the discussion How to monitor price changes on e-commerce websites using scraping? in the forum General Web Scraping a year ago
Reply to How to monitor price changes on e-commerce websites using scraping?
Implement rotating proxies and varying request times to avoid being blocked by e-commerce sites.
-
Keone Michael replied to the discussion How do I scrape geolocation-based content or location-specific data? in the forum General Web Scraping a year ago
Reply to How do I scrape geolocation-based content or location-specific data?
Some scrapers use headless browsers with geolocation set in the browser settings to bypass regional restrictions.
-
Keone Michael started the discussion What’s the learning curve like for Swift compared to other languages? in the forum General Web Scraping a year ago
What’s the learning curve like for Swift compared to other languages?
Swift is easier to learn if you’re coming from an object-oriented language like Java or C# because of its modern syntax and cleaner error handling.
-
Keone Michael changed their photo a year ago
-
Keone Michael became a registered member a year ago
-
Jude Eunomia replied to the discussion How do I handle cookies and session data when scraping? in the forum General Web Scraping a year ago
Reply to How do I handle cookies and session data when scraping?
With Selenium, cookies can be handled directly by interacting with the browser’s cookie storage.
-
Jude Eunomia replied to the discussion Best ways to extract text content from HTML tags using BeautifulSoup. in the forum General Web Scraping a year ago
Reply to Best ways to extract text content from HTML tags using BeautifulSoup.
You can combine regex with BeautifulSoup if you need to extract text that follows specific patterns within tags.
-
Jude Eunomia replied to the discussion How do I scrape geolocation-based content or location-specific data? in the forum General Web Scraping a year ago
Reply to How do I scrape geolocation-based content or location-specific data?
I use VPNs to set my location in a specific country, which helps avoid some location-based blocks.
- Load More
