simplecrawler
Advanced tools
Comparing version 1.1.4 to 1.1.5
{ | ||
"name": "simplecrawler", | ||
"description": "Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.", | ||
"version": "1.1.4", | ||
"version": "1.1.5", | ||
"homepage": "https://github.com/cgiffard/node-simplecrawler", | ||
@@ -42,3 +42,3 @@ "author": "Christopher Giffard <christopher.giffard@cgiffard.com>", | ||
"robots-parser": "^1.0.0", | ||
"urijs": "^1.16.1" | ||
"urijs": "^1.18.11" | ||
}, | ||
@@ -45,0 +45,0 @@ "devDependencies": { |
@@ -10,4 +10,4 @@ # Simple web crawler for node.js | ||
simplecrawler is designed to provide a basic, flexible and robust API for | ||
crawling websites. I wrote simplecrawler to archive, analyse, and search some | ||
very large websites. It has happily chewed through hundreds of thousands of | ||
crawling websites. It was written to archive, analyse, and search some | ||
very large websites and has happily chewed through hundreds of thousands of | ||
pages and written tens of gigabytes to disk without issue. | ||
@@ -888,10 +888,6 @@ | ||
Simplecrawler will officially support stable and LTS versions of Node which are | ||
currently supported by the Node Foundation. We will endeavour to continue to | ||
support Node 0.10.x — but now that it has fallen out of LTS it is likely we will | ||
adopt newer JS syntax and APIs which 0.10.x does not support. | ||
currently supported by the Node Foundation. | ||
Currently supported versions: | ||
- 0.10.x | ||
- 0.12.x | ||
- 4.x | ||
@@ -898,0 +894,0 @@ - 5.x |
Sorry, the diff of this file is too big to display
2685
157549
940
Updatedurijs@^1.18.11