inference-serving
PackCloud & infraLets your agent deploy large language models for fast, production-ready text generation.
Unavailable. Delivery for this kind is on the roadmap — not serving yet.
Add ahel to your AI once: Claude, ChatGPT, Cursor, Claude Code or Codex. Then ask it to use this.
About this app
Production LLM inference including vLLM, TensorRT-LLM, llama.cpp, and SGLang. Use when deploying models for production inference.
Signals
- GitHub stars
- 13k
- Forks
- 931
- Last commit
- Jun 2026
Advanced
- Item type
- plugin
- Key
orchestra-research-ai-research-skills-inference-serving- Source
- github.com/orchestra-research/ai-research-skills