scrapyjs-jsdom-server
Advanced tools
scrapyjs-jsdom-server is a Scrapyjs-compatible jsdom-based rendering service.
This Node-based server is a drop-in replacement for the default server that's used with Scrapyjs.
This project was started because the default Splash server that ScrapingHub makes almost always crashes after a few hours of heavy scraping (memory bug perhaps?).
Try using the default Splash server and if you find that you can't use it for heavy scraping, come back and use this server instead. Happy scraping!
git clone https://github.com/paulborza/scrapyjs-jsdom-server.git
cd scrapyjs-jsdom-server
npm install
cd src
supervisor app.js
npm install --save scrapyjs-jsdom-server
FAQs
Scrapyjs-compatible jsdom-based rendering service
We found that scrapyjs-jsdom-server demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Research
Socket researchers have discovered malicious npm packages targeting crypto developers, stealing credentials and wallet data using spyware delivered through typosquats of popular cryptographic libraries.
Security News
Socket's package search now displays weekly downloads for npm packages, helping developers quickly assess popularity and make more informed decisions.
Security News
A Stanford study reveals 9.5% of engineers contribute almost nothing, costing tech $90B annually, with remote work fueling the rise of "ghost engineers."