llama-tokenizer-js - npm Package Compare versions

Comparing version 1.0.0 to 1.0.1

LICENSE.md

package.json

		{
		"name": "llama-tokenizer-js",
		"version": "1.0.0",
		"version": "1.0.1",
		"description": "JS tokenizer for LLaMA-based LLMs",
		@@ -5,0 +5,0 @@ "main": "llama-tokenizer.js",

README.md

		@@ -7,2 +7,4 @@ # 🦙 llama-tokenizer-js 🦙

		<a href="https://belladoreai.github.io/llama-tokenizer-js/example-demo/build/">Click here for demo</a>

		Features:
		@@ -31,3 +33,3 @@ - Easy to use: 0 dependencies, code and data baked into a single file.
		```
		<script type="module" src="https://raw.githubusercontent.com/belladoreai/llama-tokenizer-js/master/llama-tokenizer.js"></script>
		<script type="module" src="https://belladoreai.github.io/llama-tokenizer-js/llama-tokenizer.js"></script>
		```
		@@ -44,3 +46,3 @@
		```
		llamaTokenizer.encode("Hello world")
		llamaTokenizer.encode("Hello world!")
		> [1, 15043, 3186, 29991]
		@@ -89,2 +91,2 @@ ```

		You are not required to give anything in exchange, but I kindly ask that you link to [https://belladore.ai/tools](https://belladore.ai/tools) in an appropriate place in your website. For example, you might link with the text "Using llama-tokenizer-js by belladore.ai" or something similar.
		You are not required to give anything in exchange, but I kindly ask that you give back by linking to [https://belladore.ai/tools](https://belladore.ai/tools) in an appropriate place in your website. For example, you might link with the text "Using llama-tokenizer-js by belladore.ai" or something similar.

New alerts