-
Khloe Walther replied to the discussion What are the best methods for scraping data from dynamically-loaded websites? in the forum General Web Scraping a year ago
Reply to What are the best methods for scraping data from dynamically-loaded websites?
Scrapy Splash is another option for Python users. It can render JavaScript within Scrapy pipelines, allowing you to handle dynamic content without switching libraries.
-
Khloe Walther started the discussion What’s the best way to scrape e-commerce sites for product specifications? in the forum General Web Scraping a year ago
What’s the best way to scrape e-commerce sites for product specifications?
I set up scripts to navigate product categories first, as this reduces redundant scraping of main product listings.
-
Khloe Walther changed their photo a year ago
-
Khloe Walther became a registered member a year ago
-
Ampelios Abhijit replied to the discussion How can I manage session-based scraping effectively? in the forum General Web Scraping a year ago
Reply to How can I manage session-based scraping effectively?
I’ve found headless browsers like Puppeteer useful for simulating session persistence in real-time, which is particularly helpful for complex logins or session-based navigation.
-
Ampelios Abhijit replied to the discussion How does Go’s performance compare to Node.js for building APIs? in the forum General Web Scraping a year ago
Reply to How does Go’s performance compare to Node.js for building APIs?
Both are great choices for building APIs, but Go has a slight edge in terms of raw speed and handling high concurrency with minimal overhead.
-
Ampelios Abhijit replied to the discussion What are the differences between learning Python and JavaScript for beginners? in the forum General Web Scraping a year ago
Reply to What are the differences between learning Python and JavaScript for beginners?
Both are great for beginners, but Python has a gentler learning curve due to its simplicity and extensive community support for beginners.
-
Ampelios Abhijit replied to the discussion Should I learn SQL or NoSQL databases for backend programming? in the forum General Web Scraping a year ago
Reply to Should I learn SQL or NoSQL databases for backend programming?
Learning SQL is a must for backend programming, while NoSQL can be learned as a complementary skill for specialized use cases.
-
Ampelios Abhijit started the discussion How can I scrape embedded data from audio or video content? in the forum General Web Scraping a year ago
How can I scrape embedded data from audio or video content?
Transcription APIs, like Google Speech-to-Text, are effective for converting audio to text but can be costly for long audio files.
-
Ampelios Abhijit changed their photo a year ago
- Load More
