free-proxy-checker

free-proxy_checker

NodeJS library WITHOUT any external dependencies to:

• download free proxies;
• check if free HTTP/SOCKS4/SOCKS5 proxies are working/up.

Proxy testing protocol

HTTP

To test HTTP proxies, the library makes an HTTP CONNECT request to the proxy host/IP and port. If the request doesn't generate an error/timeout and if the status code is 200, we consider the proxy is UP. We do that to ignore proxies that are up but that ignore/block our request.

SOCKS4/5

To test SOCKS proxies, we establish create a TCP socket using net.Socket and try to establish a connection with the proxy. If the connection is successful (no error and no timeout), we consider the proxy is UP.

Library installation

npm install free-proxy-checker

Library usage

You can find examples in the /examples directory.

Downloading and testing free proxies

const {ProxyChecker, ProxyScrapeDownloader, FoxtoolsDownloader, FreeProxyListDownloader, downloadAllProxies} = require('free-proxy-checker');

(async () => {
    // We can download proxies from a particular proxy provider, e.g. proxyscrape, foxtools, freeproxylist and my proxy
    const proxyScrapeDownloader = new ProxyScrapeDownloader();
    const proxyScrapeProxies = await proxyScrapeDownloader.download();

    const foxtoolsDownloader = new FoxtoolsDownloader();
    const foxtoolsProxies = await foxtoolsDownloader.download();

    // We can also download all proxies from all proxy providers at once
    const allProxies = await downloadAllProxies();

    // Then, we can check the availability of the proxies we downloaded
    // The verbose: true option enables you to see the testing progress and have a time estimate
    const proxyChecker = new ProxyChecker(allProxies, {
        concurrency: 25,
        timeout: 7500,
        verbose: true
    })

    await proxyChecker.checkProxies();
    const proxiesUp = proxyChecker.getProxiesUp();
    console.log(`There are ${proxiesUp.length} proxies UP:`);
    console.log(proxiesUp);
})();

Testing if proxies are UP/DOWN

The code snippet below shows how you can create HttpProxy and SocksProxy to create proxy instances, and pass them to a ProxyChecker to verify their availability.

const {HttpProxy, SocksProxy, ProxyChecker} = require('free-proxy-checker');


(async () => {
    const proxies = [];
    proxies.push(new HttpProxy('112.6.117.178', '8085'));
    proxies.push(new SocksProxy('5.153.140.180', '4145'));


    const proxyChecker = new ProxyChecker(proxies, {
        concurrency: 15,
        timeout: 7500,
        verbose: 30
    })

    await proxyChecker.checkProxies();
    let proxiesUp = proxyChecker.getProxiesUp();
    console.log(`There are ${proxiesUp.length} proxies UP:`);
    console.log(proxiesUp);
})();

Remarks

For the moment the library is really basic, it only checks if a proxy is UP/DOWN. It doesn't store any data about latency. Feel free to open an issue if you have a feature request. I may add it to the library if I feel like it's relevant.

Related projects

https://niek.github.io/free-proxy-list/: A page that leverages the free-proxy-checker library to display a list of available proxies. Results are updated every hour.