fasttext.wasm.js
Advanced tools
Node and Browser env supported WebAssembly version of fastText: Library for efficient text classification and representation learning.
Node and Browser env supported WebAssembly version of fastText: Library for efficient text classification and representation learning.
WebAssembly version of fastText with compressed lid.176.ftz model (~900KB) and a typescript wrapper. This project focuses on cross-platform, zero-dependency and out-of-the-box.
In Node.js, you should use this approach for binding js best performance.
import { getLIDModel } from 'fasttext.wasm.js'
const lidModel = await getLIDModel()
await lidModel.load()
const result = await lidModel.identify('Hello, world!')
console.log(result.alpha2) // 'en'
In others environments, use like below:
import { getLIDModel } from 'fasttext.wasm.js/common'
const lidModel = await getLIDModel()
// Default paths:
// {
// wasmPath: '<globalThis.location.origin>/fastText/fasttext.common.wasm',
// modelPath: '<globalThis.location.origin>/fastText/models/lid.176.ftz',
// }
await lidModel.load()
const result = await lidModel.identify('Hello, world!')
console.log(result.alpha2) // 'en'
Do not forget that download and place /fastText/fasttext.common.wasm and /fastText/models/lid.176.ftz in public root directory. You can override the default paths if necessary.
Dataset papluca/language-identification/test accuracy test result in Node.js runtime:
| Name | Error Rate | Accuracy | Total |
|---|---|---|---|
| fastText | 0.02 | 0.98 | 10000 |
| cld | 0.04 | 0.96 | 10000 |
| eld | 0.06 | 0.94 | 10000 |
| languageDetect | 0.24 | 0.76 | 10000 |
| franc | 0.27 | 0.73 | 10000 |
Bench Test task for accuracy testBench task for benchmark testor
pnpm ipnpm run buildcd benchpnpm run test for accuracy testpnpm run bench for benchmark testPay attention, add source ./emsdk_env.sh to shell profile to auto load emsdk env, and export EMSDK_QUIET=1 can be used to suppress these messages.
npm run buildnpx changesetnpx changeset versiongit commitnpx changeset publishgit push --follow-tags1.0.0
FAQs
Node and Browser env supported WebAssembly version of fastText: Library for efficient text classification and representation learning.
The npm package fasttext.wasm.js receives a total of 2,139 weekly downloads. As such, fasttext.wasm.js popularity was classified as popular.
We found that fasttext.wasm.js demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
/Security News
Socket researchers discovered nine malicious NuGet packages that use time-delayed payloads to crash applications and corrupt industrial control systems.
Security News
Socket CTO Ahmad Nassri discusses why supply chain attacks now target developer machines and what AI means for the future of enterprise security.
Security News
Learn the essential steps every developer should take to stay secure on npm and reduce exposure to supply chain attacks.