Zababa Keone
-
Zababa Keone replied to the discussion What are the limitations of web scraping with headless browsers? in the forum General Web Scraping 10 months ago
Reply to What are the limitations of web scraping with headless browsers?
Headless browsers are great for JavaScript-heavy sites but overkill for simple static HTML pages.
-
Zababa Keone replied to the discussion How can I scrape data from infinite scrolling pages (e.g., social media)? in the forum General Web Scraping 10 months ago
Reply to How can I scrape data from infinite scrolling pages (e.g., social media)?
Puppeteer works well for handling infinite scrolls by detecting when new elements load.
-
Zababa Keone started the discussion How can I scrape data and store it directly in a SQL database? in the forum General Web Scraping 10 months ago
How can I scrape data and store it directly in a SQL database?
After scraping the data using BeautifulSoup or Scrapy, you can use Python’s sqlite3 library to insert the scraped data into an SQLite database.
-
Zababa Keone changed their photo 10 months ago
-
Zababa Keone became a registered member 10 months ago
