github.com/tonytsep/chaos_downloader
A simple tool to download, organize, and consolidate data from Project Discovery's Chaos dataset.
Ensure Go is installed on your system to run this script.
git clone https://github.com/tonytsep/chaos_downloader.git
cd chaos_downloader
go run chaos_downloader.go
The script downloads ZIP files listed in https://chaos-data.projectdiscovery.io/index.json, extracts them into named directories, and compiles text from those directories into a single file named everything.txt.
Running the script processes the data and generates everything.txt in the script's execution directory, alongside a folder AllChaosData containing the organized data.
Feel free to fork, modify, or suggest improvements to this script. Any contribution is welcome.
This project is open-source, licensed under the MIT License.
FAQs
Unknown package
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Ransomware negotiators share how modern cybercriminals operate like corporations, using specialized teams, negotiation tactics, and reputation management.
Security News
PyPI confirms no security flaws were exploited in the Ultralytics supply chain attack and highlights improvements for safer package publishing.
Security News
Research
The Socket Research Team breaks down a malicious wrapper package that uses obfuscation to harvest credentials and exfiltrate sensitive data.