fasttext.wasm.js
Advanced tools
Node and Browser env supported WebAssembly version of fastText: Library for efficient text classification and representation learning.
Node and Browser env supported WebAssembly version of fastText: Library for efficient text classification and representation learning.
WebAssembly version of fastText with compressed lid.176.ftz model (~900KB) and a typescript wrapper. This project focuses on cross-platform, zero-dependency and out-of-the-box.
In Node.js, you should use this approach for binding js best performance.
import { getLIDModel } from 'fasttext.wasm.js'
const lidModel = await getLIDModel()
await lidModel.load()
const result = await lidModel.identify('Hello, world!')
console.log(result.alpha2) // 'en'
In others environments, use like below:
import { getLIDModel } from 'fasttext.wasm.js/common'
const lidModel = await getLIDModel()
// Default paths:
// {
// wasmPath: '<globalThis.location.origin>/fastText/fasttext.common.wasm',
// modelPath: '<globalThis.location.origin>/fastText/models/lid.176.ftz',
// }
await lidModel.load()
const result = await lidModel.identify('Hello, world!')
console.log(result.alpha2) // 'en'
Do not forget that download and place /fastText/fasttext.common.wasm and /fastText/models/lid.176.ftz in public root directory. You can override the default paths if necessary.
Dataset papluca/language-identification/test accuracy test result in Node.js runtime:
| Name | Error Rate | Accuracy | Total |
|---|---|---|---|
| fastText | 0.02 | 0.98 | 10000 |
| cld | 0.04 | 0.96 | 10000 |
| eld | 0.06 | 0.94 | 10000 |
| languageDetect | 0.24 | 0.76 | 10000 |
| franc | 0.27 | 0.73 | 10000 |
Bench Test task for accuracy testBench task for benchmark testor
pnpm ipnpm run buildcd benchpnpm run test for accuracy testpnpm run bench for benchmark testPay attention, add source ./emsdk_env.sh to shell profile to auto load emsdk env, and export EMSDK_QUIET=1 can be used to suppress these messages.
npm run buildnpx changesetnpx changeset versiongit commitnpx changeset publishgit push --follow-tags1.0.0
FAQs
Node and Browser env supported WebAssembly version of fastText: Library for efficient text classification and representation learning.
The npm package fasttext.wasm.js receives a total of 1,018 weekly downloads. As such, fasttext.wasm.js popularity was classified as popular.
We found that fasttext.wasm.js demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
The EU Cyber Resilience Act is prompting compliance requests that open source maintainers may not be obligated or equipped to handle.
Security News
Crates.io adds Trusted Publishing support, enabling secure GitHub Actions-based crate releases without long-lived API tokens.
Research
/Security News
Undocumented protestware found in 28 npm packages disrupts UI for Russian-language users visiting Russian and Belarusian domains.