Socket
Socket
Sign inDemoInstall

crawler-url-parser

Package Overview
Dependencies
40
Maintainers
1
Versions
21
Alerts
File Explorer

Advanced tools

Install Socket

Detect and block malicious and high-risk dependencies

Install

Comparing version 1.2.4 to 1.2.5

5

package.json
{
"name": "crawler-url-parser",
"version": "1.2.4",
"version": "1.2.5",
"description": "An `URL` parser for crawling purpose.",

@@ -52,5 +52,6 @@ "main": "crawler-url-parser.js",

},
"homepage": "https://gitlab.com/mehmet.kozan/crawler-url-parser",
"repository": {
"type": "git",
"url": "git://gitlab.com/mehmet.kozan/crawler-url-parser.git"
"url": "https://gitlab.com/mehmet.kozan/crawler-url-parser.git"
},

@@ -57,0 +58,0 @@ "author": "Mehmet Kozan <mehmet.kozan@live.com>",

29

README.md
# crawler-url-parser
> **An URL parser for crawling purpose, has more than 200 unit test cases.**
> ![avatar of crawler-url-parser](https://assets.gitlab-static.net/uploads/-/system/project/avatar/4809017/crawler-url-parser.png)
![avatar of crawler-url-parser](https://assets.gitlab-static.net/uploads/-/system/project/avatar/4809017/crawler-url-parser.png)
[![NPM Package](https://img.shields.io/npm/v/crawler-url-parser.svg?style=flat)](https://www.npmjs.org/package/crawler-url-parser)
[![Downloads Total](https://img.shields.io/npm/dt/crawler-url-parser.svg?style=flat)](https://www.npmjs.org/package/crawler-url-parser)
[![pipeline status](https://gitlab.com/mehmet.kozan/crawler-url-parser/badges/master/pipeline.svg)](https://gitlab.com/mehmet.kozan/crawler-url-parser/commits/master)
[![coverage report](https://gitlab.com/mehmet.kozan/crawler-url-parser/badges/master/coverage.svg)](https://gitlab.com/mehmet.kozan/crawler-url-parser/commits/master)

@@ -28,8 +30,31 @@ ## Installation

```js
const cup = require('crawler-url-parser');
const cup = require('crawler-url-parser');
let htmlStr=
'html> \
<body> \
<a href="http://www.stackoverflow.com/internal-1">test-link-4</a><br /> \
<a href="http://www.stackoverflow.com/internal-2">test-link-5</a><br /> \
<a href="http://www.stackoverflow.com/internal-2">test-link-6</a><br /> \
<a href="http://faq.stackoverflow.com/subdomain-1">test-link-7</a><br /> \
<a href="http://faq.stackoverflow.com/subdomain-2">test-link-8</a><br /> \
<a href="http://faq.stackoverflow.com/subdomain-2">test-link-9</a><br /> \
<a href="http://www.google.com/external-1">test-link-10</a><br /> \
<a href="http://www.google.com/external-2">test-link-11</a><br /> \
<a href="http://www.google.com/external-2">test-link-12</a><br /> \
</body> \
</html>';
let currentUrl= "http://www.stackoverflow.com/aaa/bbb/ccc";
let result = cup.extract(htmlStr,currentUrl);
console.log(result.length);
```
### Level
```js
const cup = require('crawler-url-parser');
```
### Query
```js
const cup = require('crawler-url-parser');
```

@@ -36,0 +61,0 @@ ## Test

Sorry, the diff of this file is not supported yet

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap

Packages

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc