You're Invited:Meet the Socket Team at BlackHat and DEF CON in Las Vegas, Aug 4-6.RSVP
Socket
Book a DemoInstallSign in
Socket

gguf-core

Package Overview
Dependencies
Maintainers
1
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

gguf-core

a simple way to interact llama with gguf

0.0.66
pipPyPI
Maintainers
1

GGUF core

Static Badge

This package is a GGUF (GPT-Generated Unified Format) file caller.

install the caller via pip/pip3 (once only):

pip install gguf-core

update the caller (if not in the latest version) by:

pip install gguf-core --upgrade

user manual

This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.

gguf -h

check current version

gguf -v

cli connector

with command-line interface

gguf c

gui connector

with graphical user interface

gguf g

vision connector (beta)

with vision model supported

gguf v

interface selector

selection menu for connector interface(s) above

gguf i

metadata reader

read model metadata for detail(s)

gguf r

or try model analyzor (beta)

gguf a

GGUF file(s) in the current directory will automatically be detected by the caller.

get feature

get GGUF from URL; clone/download it to the current directory

gguf get [url]

sample model list

You can either use the get feature above or opt a sample GGUF straight from the sample list by:

gguf s

gguf splitter

Split gguf into part(s) by:

gguf split

gguf merger

Merge all gguf into one by:

gguf merge

prompt generator (beta)

Generate bulk prompt/descriptor(s) by:

gguf prompt

gguf comfy (beta)

Download ComfyUI GGUF portable package with gguf node by:

gguf comfy

gguf node (beta)

Download gguf node only by:

gguf node

gguf pack (beta)

Download gguf pack by:

gguf pack

pdf analyzor (beta)

You can now load your PDF file(s) straight into the model for generating digested summary; try it out by:

gguf p

wav analyzor (offline)

You can speak/talk straight to GGUF right away; prompt WAV(s) into the model for feedback; try it out by:

gguf f

wav analyzor (online)

more accurate (via google Open api); Internet access needed; try it out by:

gguf o

launch to page/container (gguf.org)

gguf org

launch to page/container (gguf.io)

gguf io

launch to page/container (gguf.us)

gguf us

FAQs

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts