@lenml/tokenizer-deepseek_v3 - npm Package Compare versions

Comparing version 3.4.2 to 3.7.2

package.json

 {
   "name": "@lenml/tokenizer-deepseek_v3",
-  "version": "3.4.2",
+  "version": "3.7.2",
   "description": "deepseek_v3 tokenizer for NodeJS/Browser",
@@ -64,3 +64,3 @@ "source": "src/main.ts",
   "dependencies": {
-    "@lenml/tokenizers": "^3.4.0"
+    "@lenml/tokenizers": "^3.7.2"
   },
@@ -67,0 +67,0 @@ "scripts": {

readme.md

@@ -1,2 +0,1 @@
-
 # @lenml/tokenizer-deepseek_v3
@@ -9,2 +8,3 @@
 # Usage
+
 ```ts
@@ -15,17 +15,16 @@ import { fromPreTrained } from "@lenml/tokenizer-deepseek_v3";
 console.log(
-    "encode()",
-    tokenizer.encode("Hello, my dog is cute", null, {
-        add_special_tokens: true,
-    })
+  "encode()",
+  tokenizer.encode("Hello, my dog is cute", null, {
+    add_special_tokens: true,
+  })
 );
-console.log(
-    "_encode_text",
-    tokenizer._encode_text("Hello, my dog is cute")
-);
+console.log("_encode_text", tokenizer._encode_text("Hello, my dog is cute"));
 ```
 
 # Full Tokenizer API
-Complete api parameters and usage can be found in [transformer.js tokenizers document](https://huggingface.co/docs/transformers.js/api/tokenizers)
 
+Complete api parameters and usage can be found in [transformer.js tokenizers document](https://huggingface.co/docs/transformers.js/v3.0.0/api/tokenizers)
+
 # License
+
 Apache-2.0

No alert changes

Improved metrics

Total package byte prevSize

60351327

0.02%

Worsened metrics

Number of lines in readme file

29

-3.33%

Dependency changes

• Updated

  @lenml/tokenizers@^3.7.2