huggingface-local-models
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.
Install this skill
or
huggingface-local-models4 files
Comments
Sign in to leave a comment.
No comments yet. Be the first to comment!