Socket
Socket
Sign inDemoInstall

crawler-result-store

Package Overview
Dependencies
7
Maintainers
1
Versions
24
Alerts
File Explorer

Advanced tools

Install Socket

Detect and block malicious and high-risk dependencies

Install

    crawler-result-store

``` queueItem Object 当前爬取地址对象 queueItem.analysisUrlResult Array<Object> 分析html页面得出的url地址数组 queueItem.analysisResult Object 分析html页面得出的数据结果 queueIte


Version published
Weekly downloads
25
increased by4.17%
Maintainers
1
Install size
9.03 MB
Created
Weekly downloads
 

Readme

Source

queueItem数据字段

  queueItem                            Object                    当前爬取地址对象
  queueItem.analysisUrlResult          Array<Object>             分析html页面得出的url地址数组
  queueItem.analysisResult             Object                    分析html页面得出的数据结果
  queueItem.analysisResultUrls         Array<String>             分析页面解析结果中的地址数组
  queueItem.analysisResultUrlResult    Array<Object>             分析页面解析结果中的地址数组,经过queue处理
  queueItem.aiAnalysisResult           Array<Object|String>      分词解析后的结果
  queueItem.responseBody               String                    页面的html
  queueItem.statusCode                 Number                    下载页面得到的返回码
  queueItem.protocol                   String                    地址协议
  queueItem.host                       String                    host地址
  queueItem.query                      String                    querystring
  queueItem.port                       Number                    地址
  queueItem.url                        String                    完整地址
  queueItem.depth                      Number                    深度

FAQs

Last updated on 10 Mar 2017

Did you know?

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc