General Web Scraping

• All Discussions
•  Abioye Sparrow

  What’s the best programming language to learn in 2024 for web development?

  Osip Taffy replied 1 week, 5 days ago 4 Members · 3 Replies

  General Web Scraping
•  Kanchana Lalita

  How to scrape data from a website using Node.js and Puppeteer?

  Minta Danka replied 1 week, 5 days ago 3 Members · 2 Replies

  General Web Scraping
•  Nora Rhys

  What are the benefits of using Selenium for web scraping vs. API scraping?

  Kelebogile Mahendra replied 1 week, 5 days ago 3 Members · 2 Replies

  General Web Scraping
•  Sasha Voski

  How do you scrape dynamic tables that use JavaScript on a webpage?

  Kelebogile Mahendra replied 1 week, 5 days ago 3 Members · 2 Replies

  General Web Scraping
•  Margarid Ruzanna

  Is web scraping dead with the rise of anti-bot technologies?

  Joel Farzana replied 1 week, 5 days ago 3 Members · 2 Replies

  General Web Scraping
•  Ikaika Kapono

  How to avoid IP bans while scraping heavily trafficked sites?

  Joel Farzana replied 1 week, 5 days ago 8 Members · 7 Replies

  General Web Scraping
•  Magdalini Liselotte

  How do I scrape data from an online form with hidden fields?

  Uma Innes replied 1 week, 5 days ago 3 Members · 2 Replies

  General Web Scraping
•  Hovsep Gayane

  How do you handle pagination when scraping websites?

  Darrell Terpsichore replied 1 week, 5 days ago 8 Members · 7 Replies

  General Web Scraping
•  Maria Vasia

  How can I scrape data from a site that uses AJAX to load content?

  Amondi Mathis replied 1 week, 5 days ago 3 Members · 2 Replies

  General Web Scraping
•  Zeus Praxidike

  How to scrape websites that require login/authentication?

  Amondi Mathis replied 1 week, 5 days ago 4 Members · 3 Replies

  General Web Scraping
•  Damodara Antero

  How to scrape data from a website protected by Cloudflare?

  Gustaw Krista replied 1 week, 6 days ago 5 Members · 4 Replies

  General Web Scraping
•  Koa Linn

  What’s the best tool for scraping JavaScript-heavy websites?

  Emmanuele Sagit replied 1 week, 6 days ago 3 Members · 2 Replies

  General Web Scraping
•  Alby Adalberto

  What are the limitations of web scraping with headless browsers?

  Zababa Keone replied 1 week, 6 days ago 3 Members · 2 Replies

  General Web Scraping
•  Aeolus Afrodita

  How can I scrape data from infinite scrolling pages (e.g., social media)?

  Zababa Keone replied 1 week, 6 days ago 3 Members · 2 Replies

  General Web Scraping
•  Bandile Aadan

  Legal considerations and ethics of web scraping: What are the boundaries?

  Aravinda Govind replied 1 week, 6 days ago 4 Members · 3 Replies

  General Web Scraping