Product
Introducing License Enforcement in Socket
Ensure open-source compliance with Socket’s License Enforcement Beta. Set up your License Policy and secure your software!
Python3 Module to get https or socks(4/5) proxies by scraping the web.
- Python 3.9+
- pip3
Use the package manager pip to install the module. if not installed, install it using the following command.
sudo apt-get install python3-pip
It is advised to install the python requirements in a virtual environment, for that install the venv package.
python3 -m pip install venv
python3 -m venv env
source env/bin/activate
After that run the following commands:
python3 -m pip install <pkg> -U
OR
git clone https://github.com/sc4rfurry/ProxyNinja-ng-PyPi.git
cd ProxyNinja-ng-PyPi
python3 -m pip install .
==> Download the proxies
#!/usr/bin/python3
from proxy_ninja import fetch_proxies
fetch_proxies(PROXY_TYPE, OUTPUT_FILENAME, OUTPUT_FORMAT)
proxies gonna save in parent dir.
#!/usr/bin/python3
from proxy_ninja_ng import fetch_proxies
fetch_proxies("socks", "socks_proxy", "json")
==> Get proxies as json
#!/usr/bin/python3
from proxy_ninja_ng import fetch_proxies_json
json_list = fetch_proxies_json(PROXY_TYPE)
print(json_list)
This will gonna return a json list.
#!/usr/bin/python3
from proxy_ninja_ng import fetch_proxies_json
json_list = fetch_proxies_json("https")
print(json_list)
==> Get proxies List
#!/usr/bin/python3
from proxy_ninja_ng import fetch_proxies_list
_list = fetch_proxies_list(PROXY_TYPE)
print(_list)
This will gonna return a list.
#!/usr/bin/python3
from proxy_ninja_ng import fetch_proxies_list
lst = fetch_proxies_list("https")
print(lst)
Note: If you are interested in implementing this using Selenium/ChromiumDriver, please check this Project
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
If you have any feedback, please reach out to us at akalucifr@protonmail.ch
FAQs
Python3 library for scraping http/https and socks(4/5) proxies.
We found that proxy-ninja-ng demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Product
Ensure open-source compliance with Socket’s License Enforcement Beta. Set up your License Policy and secure your software!
Product
We're launching a new set of license analysis and compliance features for analyzing, managing, and complying with licenses across a range of supported languages and ecosystems.
Product
We're excited to introduce Socket Optimize, a powerful CLI command to secure open source dependencies with tested, optimized package overrides.