cloudflare scrape
Bypass Cloudflare's anti-bot page also known as I'm Under Attack Mode
Based on python library cloudflare-scrape
The anti-bot page requires a JS obfuscated math problem and http form submission after a setTimeout. The setTimeout is required, so bypassing cloudflare takes about 6 seconds.
Install
npm install @ctrl/cloudflare
Use
This package is meant to be used with got. After a failed request, use the catchCloudflare
function to resolve your request.
Requires passing cookiejar to got. Reusing the cookiejar in subsequent requests will bypass the cloudflare anti-bot page, until the cookie expires.
Call catchCloudflare(err, options)
passing the error and the options used to make the request. catchCloudflare
will rethrow if it is unable to bypass of if the error is not cloudflare related.
import { catchCloudflare } from '@ctrl/cloudflare';
import got from 'got';
import { CookieJar } from 'tough-cookie';
async function main() {
const cookieJar = new CookieJar();
const options = {
url: 'https://rlsbb.ru/support-us',
cookieJar,
retry: 0,
};
let res: got.Response<any>;
try {
res = await got(options);
} catch (error) {
res = await catchCloudflare(error, options);
}
return res.body;
}
See Also