Security News
Weekly Downloads Now Available in npm Package Search Results
Socket's package search now displays weekly downloads for npm packages, helping developers quickly assess popularity and make more informed decisions.
The simplest way to use rssspide to fetch rss list and site info. Fetch post'content ,give clean view to you.
Design and coding with all the love in the world by ShaneLau.
The simplest way to use rssspide to fetch rss list and site info.
Fetch post'content ,give clean view to you.
rss 爬虫,快速抓取站点信息和文章列表,文章的正文抓取
This project is base on feedparser and node-readability
npm install rssspider
Then:
var spide = require('rssspider');
var url = 'http://www.bigertech.com/rss';
spide.fetchRss(url).then(function(data){
console.log(data); // rss post list
});
fetchRss(url,[options])
get rss site'post list ,like this www.bigertech.com/rss
['title','description','summary','date','link','guid','author','comments','origlink','image','source','categories','enclosures']
response data Array
[{ title: '一个营销人员的自我修养',
description: '<p></p>',
summary: '</p>',
date: Wed Oct 08 2014 17:14:26 GMT+0800 (CST),
link: 'http://www.bigertech.com/learn-social-media-marketing/',
guid: 'a623d78a-dae9-4915-9caa-0fd34fb3757c',
author: '巴依老爷',
comments: null,
origlink: null,
image: {},
source: {},
categories: [],
enclosures: [] },
.... // more
]
siteInfo(url,[options])
get website info
url webiste'rss url
options what data you need ? default value:
['title','description','date','link','xmlurl','author','favicon','copyright','generator','image']
```
response data Array
{ title: '笔戈科技',
description: '简单、有趣、有价值',
date: Thu Oct 09 2014 18:15:14 GMT+0800 (CST),
link: 'http://www.bigertech.com/',
xmlurl: 'http://www.bigertech.com/rss/',
author: null,
favicon: null,
copyright: null,
generator: 'Ghost 0.5',
image: {},
feedurl: 'http://www.bigertech.com/rss' }
getCleanBody(url)
Turn any web page into a clean view. This module is based on arc90's readability project.
callback(error, article, meta)
var url = 'http://www.bigertech.com/learn-social-media-marketing/';
spide.getCleanBody(url).then(function(article){
console.log(article.content); //clean code view
});
The article content of the web page. Return false
if failed.
getAllByUrl(url,[options])
This method is similar to fetchRss
####What'more ,it fetch the clean page content.
Turn any web page into a clean view. This module is based on arc90's readability project.
url website'rss url
Array respose data
get clean view code , Clean view content
[{ title: '一个营销人员的自我修养',
content:'clean code view', // clean code view
description: '<p></p>',
summary: '</p>',
date: Wed Oct 08 2014 17:14:26 GMT+0800 (CST),
link: 'http://www.bigertech.com/learn-social-media-marketing/',
guid: 'a623d78a-dae9-4915-9caa-0fd34fb3757c',
author: '巴依老爷',
comments: null,
origlink: null,
image: {},
source: {},
categories: [],
enclosures: [] },
....... // more
]
nodeunit test/index.js
Add node 4.x support
FAQs
The simplest way to use rssspide to fetch rss list and site info. Fetch post'content ,give clean view to you.
The npm package rssspider receives a total of 26 weekly downloads. As such, rssspider popularity was classified as not popular.
We found that rssspider demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Socket's package search now displays weekly downloads for npm packages, helping developers quickly assess popularity and make more informed decisions.
Security News
A Stanford study reveals 9.5% of engineers contribute almost nothing, costing tech $90B annually, with remote work fueling the rise of "ghost engineers."
Research
Security News
Socket’s threat research team has detected six malicious npm packages typosquatting popular libraries to insert SSH backdoors.