fasttext.wasm.js

fasttext.wasm.js

WebAssembly version of fastText with compressed lid.176.ftz model (~900KB) and a typescript wrapper This project focuses on cross-platform, zero-dependency and out-of-the-box.

Features

• Written in TypeScript
• Browser, Node support
• Language identification integrated

Usage

// Node
import {
  LanguageIdentificationModel,
  initializeFastTextModule,
} from 'fasttext.wasm.js'

await initializeFastTextModule()
// Use lid.176.ftz as default model
const model = new LanguageIdentificationModel()
await model.load()
const result = await model.identify('Hello, world!')
console.log(result) // 'en'

// Browser
import {
  LanguageIdentificationModel,
  initializeFastTextModule,
} from 'fasttext.wasm.js/browser'

await initializeFastTextModule()
const model = new LanguageIdentificationModel({
  // Specific model path under public dir,
  // You can download it from https://fasttext.cc/docs/en/language-identification.html
  modelHref: '/models/lid.176.ftz',
})
await model.load()
const result = await model.identify('Hello, world!')
console.log(result) // 'en'

Benchmark

codesandbox/language-detect-benchmark

• 10x Faster and very more accurate than languagedetect

Related

• awesome-exhibition/fasttext.wasm.js - Next.js example.

Credits

• DreamOfIce/fastText.wasm
• facebookresearch/fastText/webassembly

References

• Language identification

Build & Publish

• npm run build
• npx changeset
• npx changeset version
• git commit
• npx changeset publish
• git push --follow-tags

changeset prerelease doc

License

MIT License © 2023 Yuns

Changelog

0.0.1-next.2

Patch Changes

• 📦 refactor: rename to identification