@fugood/node-llama-linux-arm64-snapdragon
Advanced tools
Native module for An another Node binding of llama.cpp (linux-arm64-snapdragon)
Native module for llama.node targeting linux-arm64-snapdragon.
This package contains the pre-compiled native module for the specified platform and architecture with Qualcomm Snapdragon OpenCL and Hexagon support.
This package is typically installed automatically as a dependency of @fugood/llama.node.
This package is not meant to be used directly. It is consumed by the main @fugood/llama.node package.
This config for best practice.
{
n_gpu_layers: 99,
devices: ['HTP0'], // All available HTP devices
flash_attn_type: 'on',
n_threads: 6,
batch_size: 128,
cache_type_k: 'q8_0',
cache_type_v: 'q8_0',
cpu_mask: '0xfc',
cpu_strict: true,
}
FAQs
Native module for An another Node binding of llama.cpp (linux-arm64-snapdragon)
We found that @fugood/node-llama-linux-arm64-snapdragon demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 5 open source maintainers collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
/Security News
A malicious NuGet package impersonating Sicoob exfiltrated client IDs, PFX passwords, and banking certificates through Sentry telemetry.
Security News
Feross Aboukhadijeh joins TBPN to discuss Socket's $60M Series C, 500%+ ARR growth, AI's impact on open source, and the rise in supply chain attacks.
Security News
OSV withdrew 157 OSV malware reports after automated false positives incorrectly flagged trusted npm and PyPI packages, sending bad records into tools that rely on OSV data.