Skip to main content

deployment

Facilitates serving LLM checkpoints as OpenAI-compatible APIs using vLLM, SGLang, or TRT-LLM for efficient model deployment.

Install this skill

or
64/100

Security score

The deployment skill was audited on May 31, 2026 and we found 12 security issues across 3 threat categories. Review the findings below before installing.

Categories Tested

Security Issues

medium line 156

Curl to non-GitHub URL

SourceSKILL.md
156curl -s http://localhost:8000/health
medium line 159

Curl to non-GitHub URL

SourceSKILL.md
159curl -s http://localhost:8000/v1/models | python -m json.tool
medium line 162

Curl to non-GitHub URL

SourceSKILL.md
162curl -s http://localhost:8000/v1/completions \
medium line 209

Curl to non-GitHub URL

SourceSKILL.md
209remote_run "curl -s http://localhost:8000/health"
medium line 210

Curl to non-GitHub URL

SourceSKILL.md
210remote_run "curl -s http://localhost:8000/v1/models"
medium line 175

Access to hidden dotfiles in home directory

SourceSKILL.md
175If a cluster config exists (`~/.config/modelopt/clusters.yaml` or `.claude/clusters.yaml`), or the user mentions running on a remote machine:
low line 156

External URL reference

SourceSKILL.md
156curl -s http://localhost:8000/health
low line 159

External URL reference

SourceSKILL.md
159curl -s http://localhost:8000/v1/models | python -m json.tool
low line 162

External URL reference

SourceSKILL.md
162curl -s http://localhost:8000/v1/completions \
low line 209

External URL reference

SourceSKILL.md
209remote_run "curl -s http://localhost:8000/health"
low line 210

External URL reference

SourceSKILL.md
210remote_run "curl -s http://localhost:8000/v1/models"
low line 213

External URL reference

SourceSKILL.md
2135. **Report the endpoint** — include the remote hostname and port so the user can connect (e.g., `http://<node_hostname>:8000`). For SLURM, note that the port is only reachable from within the cluster
Scanned on May 31, 2026
View Security Dashboard
Installation guide →