You're Invited:Meet the Socket Team at BlackHat and DEF CON in Las Vegas, Aug 7-8.RSVP
Socket
Socket
Sign inDemoInstall

scrapper-cf

Package Overview
Dependencies
Maintainers
1
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

scrapper-cf

This library is aimed at speeding up making of scrappers. The 'utils.py' file contains useful functions which allows users to raise alerts, get random user agents and hit URLs at random. This also reduces chances of getting blocked by the server


Maintainers
1

Readme

This library contains many useful function which will speed up the making of scrappers. The library focusses on efforts to ensure that the scrappers don't get blocked by the servers. It has functions which:

  • Returns a random user agent out of 10,000 user agents. The user agents are stored in a csv file inside the package.
  • Randomly hit various URLs provided by the users
  • Raise Alert in the form of e-mail and/or beeps

FAQs


Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap
  • Changelog

Packages

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc