
Research
/Security News
Toptal’s GitHub Organization Hijacked: 10 Malicious Packages Published
Threat actors hijacked Toptal’s GitHub org, publishing npm packages with malicious payloads that steal tokens and attempt to wipe victim systems.
A CLI tool to convert CSV files to Parquet format, Parquet files to CSV, and display formatted content of data files.
A powerful CLI tool for converting between CSV and Parquet formats and displaying formatted data content.
pip install dynamic-data-set
git clone https://github.com/wenruohan/dynamic-data-set.git
cd dynamic-data-set
pip install -e .
git clone https://github.com/wenruohan/dynamic-data-set.git
cd dynamic-data-set
pip install -e ".[dev]"
The tool provides two main commands: convert
and format
.
# Basic conversion
dynamic-data-set convert -i data.csv
# Specify output file
dynamic-data-set convert -i data.csv -o output.parquet
# Apply value mapping during conversion
dynamic-data-set convert -i data.csv -c status -m "active:1,inactive:0"
# Basic conversion
dynamic-data-set convert -i data.parquet
# Specify output file
dynamic-data-set convert -i data.parquet -o output.csv
# Display first 20 rows (default)
dynamic-data-set format data.csv
# Display first 50 rows
dynamic-data-set format data.parquet --max-rows 50
-i, --input
: Path to the input CSV or Parquet file (required)-o, --output
: Path to the output file (optional, auto-generated if not specified)-c, --map-column
: Column name to apply value mapping (CSV input only)-m, --map-values
: Mapping rules in format "old1:new1,old2:new2" (CSV input only)file_path
: Path to the CSV or Parquet file to display (positional argument)-n, --max-rows
: Maximum number of rows to display (default: 20)You can also use the short alias dds
:
dds convert -i data.csv
dds format data.parquet -n 30
dynamic-data-set --version
# Convert sales.csv to sales.parquet
dynamic-data-set convert -i sales.csv
# Convert data.parquet to report.csv
dynamic-data-set convert -i data.parquet -o report.csv
# Convert CSV and map status values
dynamic-data-set convert -i users.csv -c status -m "active:1,inactive:0,pending:2"
# Show first 10 rows of data
dynamic-data-set format dataset.parquet --max-rows 10
git clone https://github.com/wenruohan/dynamic-data-set.git
cd dynamic-data-set
uv sync
pre-commit install
uv run pytest
uvx ruff@latest check --fix
Ruff is integrated into the pre-commit hooks. To install the hooks:
pre-commit install
The hooks will automatically run Ruff checks before committing changes.
Contributions are welcome! Please feel free to submit a Pull Request. For major changes, please open an issue first to discuss what you would like to change.
This project is licensed under the MIT License - see the LICENSE file for details.
FAQs
A CLI tool to convert CSV files to Parquet format, Parquet files to CSV, and display formatted content of data files.
We found that dynamic-data-set demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
/Security News
Threat actors hijacked Toptal’s GitHub org, publishing npm packages with malicious payloads that steal tokens and attempt to wipe victim systems.
Research
/Security News
Socket researchers investigate 4 malicious npm and PyPI packages with 56,000+ downloads that install surveillance malware.
Security News
The ongoing npm phishing campaign escalates as attackers hijack the popular 'is' package, embedding malware in multiple versions.