Comparing version 1.0.1 to 1.0.2
1.0.2 / 2015-02-05 | ||
================== | ||
* fix url (thanks Jonah) | ||
* added: gittask | ||
* Update Readme.md | ||
1.0.1 / 2015-02-04 | ||
@@ -3,0 +10,0 @@ ================== |
{ | ||
"name": "x-ray", | ||
"version": "1.0.1", | ||
"version": "1.0.2", | ||
"description": "structure any website", | ||
"keywords": [], | ||
"keywords": ["scraper", "cheerio", "web"], | ||
"author": "Matthew Mueller <mattmuelle@gmail.cm>", | ||
"repository": { | ||
"type": "git", | ||
"url": "git://github.com/MatthewMueller/x-ray.git" | ||
"url": "git://github.com/lapwinglabs/x-ray.git" | ||
}, | ||
@@ -25,2 +25,2 @@ "dependencies": { | ||
"main": "index" | ||
} | ||
} |
![x-ray](https://cldup.com/r-PhcugeZ0.svg) | ||
## Introduction | ||
## Introduction [![img](https://gittask.com/lapwinglabs/x-ray.svg)](https://gittask.com/lapwinglabs/x-ray) | ||
@@ -32,3 +32,3 @@ ```js | ||
- ** Flexible schema:** Supports strings, arrays, arrays of objects, and nested object structures. The schema is not tied to the structure of the page you're scraping, allowing you to pull the data in the structure of your choosing. | ||
- **Flexible schema:** Supports strings, arrays, arrays of objects, and nested object structures. The schema is not tied to the structure of the page you're scraping, allowing you to pull the data in the structure of your choosing. | ||
@@ -241,3 +241,3 @@ - **Pagination support:** Paginate through websites, scraping each page. X-ray also supports a request `delay` and a pagination `limit`. Scraped pages can be streamed to a file, so if there's an error on one page, you won't lose what you've already scraped. | ||
Start the scrapper, calling `fn` when we're done scrapping. | ||
Start the scraper, calling `fn` when we're done scraping. | ||
@@ -261,3 +261,3 @@ ```js | ||
Start the scrapper, streaming each page to `filepath`. Returns a [`WritableStream`](http://nodejs.org/docs/latest/api/stream.html#stream_class_stream_writable). | ||
Start the scraper, streaming each page to `filepath`. Returns a [`WritableStream`](http://nodejs.org/docs/latest/api/stream.html#stream_class_stream_writable). | ||
@@ -307,3 +307,3 @@ ##### Streaming to a file | ||
- Logo uses a modified version of [XOXO](http://thenounproject.com/xoxo/)'s [Network](http://thenounproject.com/term/network/23949/). | ||
- Segment's [Nightmare](http://nightmarejs.org) provides the spine for the PhantomJS driver. | ||
- Segment's [Nightmare](http://nightmarejs.org) provides the spine for the [PhantomJS driver](http://github.com/lapwinglabs/x-ray-phantom). | ||
@@ -310,0 +310,0 @@ ## License |
17503