Security News
Opengrep Emerges as Open Source Alternative Amid Semgrep Licensing Controversy
Opengrep forks Semgrep to preserve open source SAST in response to controversial licensing changes.
By Sarah Gooding - Jan 28, 2025
New Case Study:See how Anthropic automated 95% of dependency reviews with Socket.Learn More →
- Maintainers
- 1
Thongna 🌾
Thongna (ท้องนา) is a high-performance text processing library for the Thai language, built with Rust and exposed as a Python package. Inspired by PyThaiNLP, Thongna aims to provide efficient Thai language processing tools with the speed and reliability of Rust.
Features
- Efficient Thai word segmentation: Break Thai text into meaningful tokens using the NewMM algorithm.
- Fast and reliable: Built with Rust, Thongna offers the performance you need for large-scale text processing.
- Python integration: Easily use Thongna in your Python projects with its simple and intuitive API.
- Custom dictionary support: Load and use custom dictionaries for specialized segmentation tasks.
- Text normalization: Standardize Thai text by handling common inconsistencies and variations.
- Parallel processing: Utilize multi-core processors for faster processing of large texts.
- Safe mode: Prevent infinite loops in tokenization for extra reliability.
Project Details
- Version: 0.2.2 (as of the latest release)
- License: Apache-2.0
- Supported Python versions: 3.8+
- Rust edition: 2021
- Key dependencies:
- PyO3 for Rust-Python interoperability
- Rayon for parallel processing
- Regex for text manipulation
- CI/CD: Utilizes GitHub Actions for automated testing and building on multiple platforms (Linux, macOS, Windows)
- Package distribution: Available on PyPI, with pre-built wheels for various platforms and architectures
Installation
To install Thongna, ensure you have Python 3.8+ installed, then use pip:
Why Thongna? 🌾
The name "Thongna" (ท้องนา) means "rice field" in Thai, symbolizing growth, nourishment, and the foundational aspects of life. Just like a rice field sustains life, Thongna provides the essential tools for working with Thai text, ensuring that your applications can grow and thrive.
Contributing
We welcome contributions from the community! If you’d like to contribute to Thongna, please follow these steps:
- Fork the repository.
- Create a new branch for your feature or bugfix.
- Submit a pull request with a clear explanation of your changes.
License
Thongna is licensed under the Apache License. See the LICENSE file for more details.
Contact
For any questions, suggestions, or issues, feel free to open an issue or contact the maintainers directly.
Keywords
FAQs
Blazing-fast Thai text processing library powered by Rust
We found that thongna demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Related posts
Security News
Node.js EOL Versions CVE Dubbed the "Worst CVE of the Year" by Security Experts
Critics call the Node.js EOL CVE a misuse of the system, sparking debate over CVE standards and the growing noise in vulnerability databases.
By Sarah Gooding - Jan 24, 2025
Security News
cURL Project and Go Security Teams Reject CVSS as Broken
cURL and Go security teams are publicly rejecting CVSS as flawed for assessing vulnerabilities and are calling for more accurate, context-aware approaches.
By Sarah Gooding - Jan 24, 2025