@ocelotbot/tinyld
Advanced tools
Readme
Tiny Language Detector, simply detect the language of a unicode UTF-8 text:
yarn add tinyld # or npm install --save tinyld
import { detect, detectAll } from 'tinyld'
// Detect
detect('これは日本語です.') // ja
detect('and this is english.') // en
// DetectAll
detectAll('ceci est un text en francais.')
// [ { lang: 'fr', accuracy: 0.5238 }, { lang: 'ro', accuracy: 0.3802 }, ... ]
tinyld This is the text that I want to check
# [ { lang: 'en', accuracy: 1 } ]
Benchmark done on tatoeba dataset (~9M sentences) on 16 of the most common languages.
| Library | Script | Properly Identified | Improperly identified | Not identified | Avg Execution Time | Disk Size |
|---|---|---|---|---|---|---|
| TinyLD | yarn bench:tinyld | 96.1747% | 2.6938% | 1.1315% | 0.1315ms. | 778KB |
| TinyLD Web | yarn bench:tinyld-light | 92.1169% | 3.9536% | 3.9295% | 0.0616ms. | 89KB |
| node-cld | yarn bench:cld | 88.9148% | 1.7489% | 9.3363% | 0.0612ms. | > 10MB |
| node-lingua | yarn bench:lingua | 82.3157% | 0.2158% | 17.4685% | 0.7085ms. | ~100MB |
| franc | yarn bench:franc | 68.7783% | 26.3432% | 4.8785% | 0.1381ms. | 267KB |
| franc-min | yarn bench:franc-min | 65.5163% | 23.5794% | 10.9044% | 0.0614ms. | 119KB |
| languagedetect | yarn bench:languagedetect | 61.6068% | 12.295% | 26.0982% | 0.1585ms. | 240KB |
jpn, cmn, kor, hinfra, spa, por, ita, nld, eng, deu, fin, rustur, heb, araTinyLD or node-cld (fast and accurate)TinyLD Light or franc-min (small, decent accuracy, franc is less accurate but support more languages)node-lingua is just too big and slowlanguagedetect is light but just not accurate enough, really focused on indo-european languages (support kazakh but not chinese, korean or japanese)FAQs
Simple and Performant Language detection library (pure JS and zero dependencies)
The npm package @ocelotbot/tinyld receives a total of 2,057 weekly downloads. As such, @ocelotbot/tinyld popularity was classified as popular.
We found that @ocelotbot/tinyld demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 2 open source maintainers collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
UnitedHealth Group disclosed that the ransomware attack on Change Healthcare compromised protected health information for millions in the U.S., with estimated costs to the company expected to reach $1 billion.
Security News
GitHub is susceptible to a CDN flaw that allows attackers to host malware on any public repository.
Security News
At Node Congress, Socket CEO Feross Aboukhadijeh uncovers the darker aspects of open source, where applications that rely heavily on third-party dependencies can be exploited in supply chain attacks.