🚀 Big News: Socket Acquires Coana to Bring Reachability Analysis to Every Appsec Team.Learn more

langcrawler

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

langcrawler

Language Crawler

0.0.4
91

Supply Chain Security

100

Vulnerability

98

Quality

100

Maintenance

100

License

Unpopular package

Quality

This package is not very popular.

Found 1 instance in 1 package

Network access

Supply chain risk

This module accesses the network.

Found 1 instance in 1 package

Maintainers
1

langcrawler

Actions Status PyPI License

langcrawler is a language crawler written in Python.

See Lang Fetcher as a language fetcher from langcrawler.

Requirement

  • PostgreSQL >= 12.4
  • Python >= 3.8
  • Redis >= 6.0

Installation

Ubuntu

apt update
apt install -y python3-dev python3-pip python3-setuptools
pip install langcrawler

Windows

# Install Python, Microsoft Visual C++ and Windows SDK
pip install langcrawler

Updating

pip install langcrawler --upgrade

Running

langcrawler \
  --pg-address 127.0.0.1:5432 \
  --pg-login postgres/postgres \
  --redis-address 127.0.0.1:6379 \
  --redis-pass redis \
  --repo-count 1 \
  --repo-host gerrit,github,gitlab \
  --repo-lang go,javascript,php,python,rust,typescript

Usage

usage: crawler.py [-h] [--pg-address PG_ADDRESS] [--pg-login PG_LOGIN]
                  [--redis-address REDIS_ADDRESS] [--redis-pass REDIS_PASS]
                  [--repo-count REPO_COUNT] [--repo-host REPO_HOST]
                  [--repo-lang REPO_LANG] [-v]

Language Crawler

optional arguments:
  -h, --help            show this help message and exit
  --pg-address PG_ADDRESS
                        postgres address (host:port)
  --pg-login PG_LOGIN   postgres login (user/pass)
  --redis-address REDIS_ADDRESS
                        redis address (host:port)
  --redis-pass REDIS_PASS
                        redis pass
  --repo-count REPO_COUNT
                        repository count
  --repo-host REPO_HOST
                        repository host
  --repo-lang REPO_LANG
                        repository language
  -v, --version         show program's version number and exit

Design

design

License

Project License can be found here.

Reference

FAQs

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts