free-verify-proxy

Free Verify Proxy

free_verify_proxy is a Python library that collects free proxies from various sources and verifies whether they are functional. It checks the reliability of proxies by making requests to multiple proxy detection servers. This library is useful for developers, researchers, and web scrapers who need working proxies for their applications.

Features

• Scrapes free proxies from multiple public proxy lists.

• Supports filtering proxies based on country, protocol, and anonymity level.

• Multi-threaded proxy verification for high performance.

• Uses multiple proxy judge URLs for accurate testing.

• Returns a verified list of working proxies.

Proxy Sources

Public Proxy Lists (HTTP/HTTPS)

• SSL Proxies
• Free Proxy List
• US Proxy
• UK Proxy
• Anonymous Proxy
• FreeProxy World
• ProxyScrape
• Proxy List Download
• Geonode Proxy
• IP Royal
• ProxyDB
• Advanced Name
• Free Proxy List CC
• Proxy Site List

Proxy Judges/Checkers

HTTP/HTTPS

• ProxyJudge
• MojeIP
• ifconfig.me
• ipinfo.io
• checkip.amazonaws.com
• ipify.org
• httpbin.org
• icanhazip.com
• jsonip.com
• SeeIP
• SmartProxy
• ip-api.com
• ip.nf

Note: The library uses many more proxy judges for better accuracy, ensuring reliable proxy verification.

Installation

You can install free_verify_proxy via pip:

pip install free-verify-proxy

or

pip install git+https://github.com/mominurr/free_verify_proxy.git

When installing free_verify_proxy using pip, the necessary dependencies (requests, curl_cffi, country_converter and beautifulsoup4) will be automatically installed along with the package. You don't need to separately install these dependencies.

Usage:

Parameters

• countryCodes (list, optional):
  A list of country codes (ISO 3166-1 alpha-2 format) to filter proxies by location.
  Example: ["US", "IE", "FR"]
  Default: ["all"] (Includes proxies from all countries).

• excludedCountries (list, optional):
  A list of country codes to exclude from the proxy list.
  Example: ["US", "CN"]
  Default: [] (No exclusion).

• protocols (list, optional):
  A list of protocols to filter proxies by supported protocol type.
  Supported values: ["http", "https"]
  Example: ["http"]
  Default: ["all"] (Includes all protocol types).

• anonymityLevels (list, optional):
  A list of anonymity levels to filter proxies by their anonymity.
  Supported values: ["transparent", "anonymous", "high", "elite"]
  Example: ["elite", "anonymous"]
  Default: ["all"] (Includes all anonymity levels).

• number_of_threads (int, optional):
  Number of threads to use for parallel proxy verification.
  Default: 100.

• timeout (tuple, optional):
  A timeout (connect, read) in seconds for proxy verification.
  Example: (5, 5) (5-second timeout for connection and read).
  Default: (5, 5).

Default Case (No Filters Applied):

If you don't need to apply any filters and want to retrieve and verify proxies from all countries, protocols, and anonymity levels, simply call the method without any arguments:

from free_verify_proxy import VerifyProxyLists

# Instantiate the VerifyProxyLists class
verify_proxy_lists = VerifyProxyLists()

# Retrieve the verified proxy list with no filters (includes all proxies)
verified_proxies = verify_proxy_lists.get_verifyProxyLists()

# Print the list of verified proxies
print(verified_proxies)

# Example Output:
[
  {'proxy': '3.127.121.101:80', 'countryCode': 'DE', 'protocol': 'http', 'anonymityLevel': 'elite'}, 
  {'proxy': '13.36.104.85:80', 'countryCode': 'FR', 'protocol': 'http', 'anonymityLevel': 'elite'},
  ...
  {'proxy': '15.236.106.236:3128', 'countryCode': 'FR', 'protocol': 'https', 'anonymityLevel': 'high anonymous'}
]

Custom Case (With Filters Applied):

You can also customize the filters to narrow down the list of proxies. Below is an example of how to filter proxies by country code, protocol, anonymity level, and more:

from free_verify_proxy import VerifyProxyLists

# Instantiate the VerifyProxyLists class
verify_proxy_lists = VerifyProxyLists()

# Retrieve the verified proxy list based on specific filters (optional)
verified_proxies = verify_proxy_lists.get_verifyProxyLists(
    countryCodes=["US", "FR"],           # Filter proxies by country codes (e.g., "US", "FR")
    protocols=["http", "https"],         # Filter proxies by protocol (e.g., "http", "https")
    anonymityLevels=["elite"],           # Filter proxies by anonymity level (e.g., "elite")
    excludedCountries=["CN"],            # Exclude proxies from specific countries (e.g., "CN")
    number_of_threads=150,               # Use 150 threads for parallel verification
    timeout=(5, 5)                       # Set connection and read timeout to 5 seconds
)

# Print the list of verified proxies
print(verified_proxies)

# Example Output:
[
  {'proxy': '3.127.121.101:80', 'countryCode': 'DE', 'protocol': 'http', 'anonymityLevel': 'elite'}, 
  {'proxy': '13.36.104.85:80', 'countryCode': 'FR', 'protocol': 'http', 'anonymityLevel': 'elite'},
  ...
  {'proxy': '13.54.47.197:80', 'countryCode': 'AU', 'protocol': 'https', 'anonymityLevel': 'elite'}
]

Contributing

Contributions are welcome! If you have any ideas, suggestions, or improvements, feel free to open an issue or create a pull request on GitHub.

License

This project is licensed under the MIT License - see the LICENSE file for details.