gskrawler will enter your domain and scan every page of your website, extracting page titles, descriptions, keywords, and links etc..
Description: gskrawler ==============
gskcrawler will enter your domain and scan every page of your website, extracting page titles, descriptions, keywords, and links etc..
Requirements
============================
BeautifulSoup4
requests
urllib3 1.22
Commands
============================
<head>
------------
gskrawler.head(url)
<title>
------------
gskrawler.title(url)
<body>
------------
gskrawler.body(url)
response in html format
------------
gskrawler.html(url)
links in a website
------------
gskrawler.links(url)
class elements
------------
gskrawler.tagclass(url,tagname,classname)
id elements
------------
gskrawler.tagid(url,tagname,idname)
emails in a website
------------
gskrawler.emails(url)
images in a website
------------
gskrawler.images(url)
----
Example Code
------------
Open Python Interpreter::
>>> import gskrawler
>>> gskrawler.emails('https://www.fisglobal.com/')
>>> gskrawler.images('https://www.fisglobal.com/')
>>> gskrawler.head('https://www.fisglobal.com/')
>>> gskrawler.tagclass('https://www.naukri.com/','ul','set')
FAQs
gskrawler will enter your domain and scan every page of your website, extracting page titles, descriptions, keywords, and links etc..
We found that gskrawler demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
/Security News
A flawed sandbox in @nestjs/devtools-integration lets attackers run code on your machine via CSRF, leading to full Remote Code Execution (RCE).
Product
Customize license detection with Socket’s new license overlays: gain control, reduce noise, and handle edge cases with precision.
Product
Socket now supports Rust and Cargo, offering package search for all users and experimental SBOM generation for enterprise projects.