Zababa Keone
-
Zababa Keone replied to the discussion What are the limitations of web scraping with headless browsers? in the forum General Web Scraping 9 months ago
Reply to What are the limitations of web scraping with headless browsers?
Headless browsers are great for JavaScript-heavy sites but overkill for simple static HTML pages.
-
Zababa Keone replied to the discussion How can I scrape data from infinite scrolling pages (e.g., social media)? in the forum General Web Scraping 9 months ago
Reply to How can I scrape data from infinite scrolling pages (e.g., social media)?
Puppeteer works well for handling infinite scrolls by detecting when new elements load.
-
Zababa Keone started the discussion How can I scrape data and store it directly in a SQL database? in the forum General Web Scraping 9 months ago
How can I scrape data and store it directly in a SQL database?
After scraping the data using BeautifulSoup or Scrapy, you can use Python’s sqlite3 library to insert the scraped data into an SQLite database.
-
Zababa Keone changed their photo 9 months ago
-
Zababa Keone became a registered member 9 months ago
