crawler-url-parser
Advanced tools
Comparing version 1.2.3 to 1.2.4
{ | ||
"name": "crawler-url-parser", | ||
"version": "1.2.3", | ||
"version": "1.2.4", | ||
"description": "An `URL` parser for crawling purpose.", | ||
@@ -5,0 +5,0 @@ "main": "crawler-url-parser.js", |
# crawler-url-parser | ||
> **An `URL` parser for crawling purpose, has more than 200 unit test cases.** | ||
![avatar of crawler-url-parser](https://assets.gitlab-static.net/uploads/-/system/project/avatar/4809017/crawler-url-parser.png) | ||
> **An URL parser for crawling purpose, has more than 200 unit test cases.** | ||
> ![avatar of crawler-url-parser](https://assets.gitlab-static.net/uploads/-/system/project/avatar/4809017/crawler-url-parser.png) | ||
[![NPM Package](https://img.shields.io/npm/v/crawler-url-parser.svg?style=flat)](https://www.npmjs.org/package/crawler-url-parser) | ||
@@ -26,27 +28,13 @@ [![Downloads Total](https://img.shields.io/npm/dt/crawler-url-parser.svg?style=flat)](https://www.npmjs.org/package/crawler-url-parser) | ||
```js | ||
const cup = require('crawler-url-parser'); | ||
let htmlStr= | ||
'html> \ | ||
<body> \ | ||
<a href="http://www.stackoverflow.com/internal-1">test-link-4</a><br /> \ | ||
<a href="http://www.stackoverflow.com/internal-2">test-link-5</a><br /> \ | ||
<a href="http://www.stackoverflow.com/internal-2">test-link-6</a><br /> \ | ||
<a href="http://faq.stackoverflow.com/subdomain-1">test-link-7</a><br /> \ | ||
<a href="http://faq.stackoverflow.com/subdomain-2">test-link-8</a><br /> \ | ||
<a href="http://faq.stackoverflow.com/subdomain-2">test-link-9</a><br /> \ | ||
<a href="http://www.google.com/external-1">test-link-10</a><br /> \ | ||
<a href="http://www.google.com/external-2">test-link-11</a><br /> \ | ||
<a href="http://www.google.com/external-2">test-link-12</a><br /> \ | ||
</body> \ | ||
</html>'; | ||
let currentUrl= "http://www.stackoverflow.com/aaa/bbb/ccc"; | ||
let result = cup.extract(htmlStr,currentUrl); | ||
console.log(result.length); | ||
const cup = require('crawler-url-parser'); | ||
``` | ||
### Level | ||
### Query | ||
## Test | ||
`mocha` or `npm test` | ||
* check test folder and quickstart.js for extra usage. | ||
> check test folder and quickstart.js for extra usage. | ||
## API |
Major refactor
Supply chain riskPackage has recently undergone a major refactor. It may be unstable or indicate significant internal changes. Use caution when updating to versions that include significant changes.
Found 1 instance in 1 package
0
52608
40