Automatically extracts structured information from webpages. 

Automatically extracts structured information from webpages

vasanthgopal

web-auto-extractor

Error

Ignore

Warn

License

Maintenance

Miscellaneous

Quality

Supply chain risk

Vulnerability

Admins only

Organization members

Dashboard

<upgradeLink>Upgrade</upgradeLink> to access this feature

About

Blog

Socket CLI

Customers

Socket Dependency Search

Docs

Socket for GitHub

Love

Impersonation Mode Active

Update your browser to the latest version for the best experience.

Your web browser is outdated

Use another browser for the best experience.

Your web browser is unsupported

{{count, number}} commits last two months

{{count, number}} critical severity alert

{{count, number}} critical severity alerts

{{count, number}} dependency vulnerability

{{count, number}} dependency vulnerabilities

{{count, number}} development dependencies

{{count, number}} transitive dependencies

{{count, number}} version published last month

{{count, number}} versions published last month

{{count, number}} version published in last two months

{{count, number}} versions published in last two months

{{count, number}} version published last week

{{count, number}} versions published last week

{{count, number}} version published last year

{{count, number}} versions published last year

Socket undergoes annual SOC2 Type II audits. Socket customers can request a copy of the full SOC2 Type II report.

Allows organization owners and admins to access detailed records of actions taken by members of their organization, complete with timestamps.

Prevent compromised packages from infiltrating your supply chain by monitoring for changes in real-time.

Join our Discord community to get help from Socket engineers and other Socket users.

Compare millions of open source packages on socket.dev

Detect malicious code and risky behavior (e.g. network) in your dependencies using "deep package inspection"

All data is encrypted in transit and at rest using industry standard encryption algorithms.

Get a dedicated Socket account manager and access to Socket’s Customer Success team.

Get dedicated support from Socket engineers via email and Slack.

"Shift left" with the Socket Chrome extension and give intervene early, before developers choose risky or low quality dependencies.

Catch developers using risky dependencies and give them a "speed bump" to encourage good behavior

Install the Socket GitHub app to receive real-time dependency scanning and reports with every pull request.

Integrate Socket into your GitHub SCM to prevent risky dependencies from being installed.

Socket scans for vulnerabilities in your dependencies, including CVEs, security advisories, and more.

Socket supports dependencies in many languages, with most popular ecosystems coming in 2024. We've got you covered no matter what languages you use.

Enforce license policies across your organization

Receive a Microsoft Teams message to the channel of your choice anytime Socket runs a new analysis, has a new finding, or a policy has changed.

Get help migrating from Socket's free plan to Socket's paid plans.

Run Socket on-premises or in your own cloud environment.

Query for any dependency (at any version) across your entire organization

Integrate Socket into your CI/CD pipeline to prevent risky dependencies from being deployed to production.

Analyze an entire project to find supply chain risks

Tag projects to organize and filter your projects

Restrict access based on the roles of individual users within an organization.

Receive a Slack message to the channel of your choice anytime Socket runs a new analysis, has a new finding, or a policy has changed.

Socket is SOC2 Type II compliant and undergoes annual audits.

The Socket CLI allows teams to prevent risky dependencies from being installed, and to get dependency insights from the command line.

Socket supports SAML SSO for single sign-on and identity management.

Integrate Socket into your VS Code IDE to prevent risky dependencies from being installed.

Get a POST request anytime Socket runs a new analysis, has a new finding, or a policy has changed.

Socket will analyzed your SBOMs up to a maximum number of dependencies.

API that allows you to analyze a project, lookup package scores and alerts, and more.

Create API tokens to authenticate with the Socket API and CLI.

The number of developers in your team. A developer is someone who made a commit to your organization's repositories scanned by Socket in the past month.

Use Socket to protect your private repositories.

Socket is always free for open source projects.

Socket retains all reporting data for 3 months, 1 year, or a custom term of your choice.

Access the threat feed that powers Socket.

Unlimited scale, self-hosting, and priority support for large teams.

For open-source projects, individuals, and small teams.

For growing teams with enhanced scale, security, and support.

There is a package with a similar name that is downloaded much more often.

There are packages with similar names that are downloaded much more often.

This may not be the package you want!

Instance

Alert Locations

Package

The {{ecosystem}} package {{- packageName}} receives a total of <strong>{{numWeeklyDownloadCount, number}}</strong> weekly downloads. As such, {{- packageName}} popularity was classified as <strong>{{popularity}}</strong>.

Is {{- packageName}} popular?

Is {{- packageName}} safe to use?

Is {{- packageName}} well maintained?

What is {{- packageName}}?

{{packageDescription}}Version: {{versionString}} was published by {{publisherName}}. Start using Socket to analyze {{- packageName}} and its {{dependencyCount, number}} dependencies to secure your app from supply chain attacks.

Sorry, it seems this package was removed from the registry

Package was removed

This package version has been unpublished, mostly likely due to security reasons

Package version was removed

Provide a detailed description of the malware...

Socket fights vulnerabilities and provides visibility, defense-in-depth, and proactive supply chain protection for JavaScript, Python, and Go dependencies.

Socket - Secure your dependencies. Ship with confidence.

Compare versions

{{- packageName}} - npm Package Compare versions

Object.defineProperty(exports, "__esModule", {

var _htmlparser = require('htmlparser2');

var _htmlparser2 = _interopRequireDefault(_htmlparser);

var _lodash2 = _interopRequireDefault(_lodash);

function _interopRequireDefault(obj) { return obj && obj.__esModule ? obj : { default: obj }; }

function getPropValue(tagName, attribs, TYPE, PROP) {

  } else if (tagName === 'a' || tagName === 'link') {

  } else if (attribs[PROP] === 'image' && attribs.src) {

var getAttrNames = function getAttrNames(specName) {

  if (specName.toLowerCase().startsWith('micro')) {

  } else if (specName.toLowerCase().startsWith('rdfa')) {

    throw new Error('Unsupported spec: use either micro or rdfa');

var getType = function getType(typeString) {

  var match = /(.*\/)(\w+)/g.exec(typeString);

    context: match && match[1] ? match[1] : undefined,

    type: match && match[2] ? match[2] : typeString

var createHandler = function createHandler(specName) {

  var _getAttrNames = getAttrNames(specName);

  var onopentag = function onopentag(tagName, attribs) {

    var currentScope = scopes[scopes.length - 1];

      if (attribs[PROP] && currentScope) {

        currentScope[attribs[PROP]] = currentScope[attribs[PROP]] || [];

        currentScope[attribs[PROP]].push(newScope);

        var _getType = getType(attribs[TYPE]);

        topLevelScope[type] = topLevelScope[type] || [];

        topLevelScope[type].push(currentScope);

        var _getType2 = getType(attribs[TYPE]);

        currentScope['@context'] = context || vocab;

        if (currentScope[attribs[PROP]] && !Array.isArray(currentScope[attribs[PROP]])) {

          // PROP occurs for the second time, storing it as an array

          currentScope[attribs[PROP]] = [currentScope[attribs[PROP]]];

        var value = getPropValue(tagName, attribs, TYPE, PROP);

          currentScope[attribs[PROP]] = '';

          if (Array.isArray(currentScope[attribs[PROP]])) {

            currentScope[attribs[PROP]].push('');

            currentScope[attribs[PROP]] = '';

          currentScope[attribs[PROP]] = value;

            currentScope[attribs[PROP]].push(value);

            currentScope[attribs[PROP]] = value;

      scopes[scopes.length - 1][textForProp] += text.trim();

      if (Array.isArray(scopes[scopes.length - 1][textForProp])) {

        scopes[scopes.length - 1][textForProp][scopes[scopes.length - 1][textForProp].length - 1] += text.trim();

        scopes[scopes.length - 1][textForProp] += text.trim();

  var onclosetag = function onclosetag(tagname) {

        Object.keys(scope).forEach(function (key) {

          if (_lodash2.default.isArray(scope[key]) && scope[key].length === 1) {

exports.default = function (html, specName) {

  new _htmlparser2.default.Parser(handler).end(html);

  "description": "Automatically extracts structured information from webpages",

    "test": "mocha --recursive --compilers js:babel-register",

    "dev": "nodemon --exec npm run lint",

    "prepublish": "npm run lint && npm run test && npm run build"

    "url": "https://github.com/ind9/web-auto-extractor.git"

    "url": "https://github.com/ind9/web-auto-extractor/issues"

  "tonicExampleFilename": "tonicExample.js"

		{
		"name": "web-auto-extractor",
		"version": "1.0.8",
		"version": "1.0.9",
		"description": "Automatically extracts structured information from webpages",
		@@ -5,0 +5,0 @@ "main": "dist/index.js",

Fixed alerts

Improved metrics

		@@ -101,9 +101,22 @@ 'use strict';
		} else if (attribs[PROP]) {
		if (currentScope[attribs[PROP]] && !Array.isArray(currentScope[attribs[PROP]])) {
		// PROP occurs for the second time, storing it as an array
		currentScope[attribs[PROP]] = [currentScope[attribs[PROP]]];
		}

		var value = getPropValue(tagName, attribs, TYPE, PROP);
		if (!value) {
		tag = PROP;
		currentScope[attribs[PROP]] = '';
		if (Array.isArray(currentScope[attribs[PROP]])) {
		currentScope[attribs[PROP]].push('');
		} else {
		currentScope[attribs[PROP]] = '';
		}
		textForProp = attribs[PROP];
		} else {
		currentScope[attribs[PROP]] = value;
		if (Array.isArray(currentScope[attribs[PROP]])) {
		currentScope[attribs[PROP]].push(value);
		} else {
		currentScope[attribs[PROP]] = value;
		}
		}
		@@ -116,3 +129,7 @@ }
		if (textForProp) {
		scopes[scopes.length - 1][textForProp] += text.trim();
		if (Array.isArray(scopes[scopes.length - 1][textForProp])) {
		scopes[scopes.length - 1][textForProp][scopes[scopes.length - 1][textForProp].length - 1] += text.trim();
		} else {
		scopes[scopes.length - 1][textForProp] += text.trim();
		}
		}
		@@ -119,0 +136,0 @@ };