github.com/tonytsep/chaos_downloader
A simple tool to download, organize, and consolidate data from Project Discovery's Chaos dataset.
Ensure Go is installed on your system to run this script.
git clone https://github.com/tonytsep/chaos_downloader.git
cd chaos_downloader
go run chaos_downloader.go
The script downloads ZIP files listed in https://chaos-data.projectdiscovery.io/index.json, extracts them into named directories, and compiles text from those directories into a single file named everything.txt.
Running the script processes the data and generates everything.txt in the script's execution directory, alongside a folder AllChaosData containing the organized data.
Feel free to fork, modify, or suggest improvements to this script. Any contribution is welcome.
This project is open-source, licensed under the MIT License.
FAQs
Unknown package
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
vlt's new "reproduce" tool verifies npm packages against their source code, outperforming traditional provenance adoption in the JavaScript ecosystem.
Research
Security News
Socket researchers uncovered a malicious PyPI package exploiting Deezer’s API to enable coordinated music piracy through API abuse and C2 server control.
Research
The Socket Research Team discovered a malicious npm package, '@ton-wallet/create', stealing cryptocurrency wallet keys from developers and users in the TON ecosystem.