Back to skills
SkillHub ClubResearch & OpsData / AIDevOps

ai-llm-inference

Provides concrete operational patterns for optimizing LLM inference, covering latency budgeting, batching, quantization, and parallelism. Includes decision trees and configuration templates for production deployment. Focuses on measurable performance improvements and cost control.

Packaged view

This page reorganizes the original catalog entry around fit, installability, and workflow context first. The original raw source lives below.

Stars
42
Hot score
90
Updated
March 20, 2026
Overall rating
A8.2
Composite score
6.2
Best-practice grade
C62.3

Install command

npx @skill-hub/cli install vasilyu1983-ai-agents-public-ai-llm-inference
llm-opsmodel-servinginference-optimizationproduction-ml

Repository

vasilyu1983/AI-Agents-public

Skill path: frameworks/shared-skills/skills/ai-llm-inference

Provides concrete operational patterns for optimizing LLM inference, covering latency budgeting, batching, quantization, and parallelism. Includes decision trees and configuration templates for production deployment. Focuses on measurable performance improvements and cost control.

Open repository

Best for

Primary workflow: Research & Ops.

Technical facets: Data / AI, DevOps.

Target audience: AI/ML teams looking for install-ready agent workflows..

License: Unknown.

Original source

Catalog source: SkillHub Club.

Repository owner: vasilyu1983.

This is still a mirrored public skill entry. Review the repository before installing into production workflows.

What it helps with

  • Install ai-llm-inference into Claude Code, Codex CLI, Gemini CLI, or OpenCode workflows
  • Review https://github.com/vasilyu1983/AI-Agents-public before adding ai-llm-inference to shared team environments
  • Use ai-llm-inference for ai/ml workflows

Works across

Claude CodeCodex CLIGemini CLIOpenCode

Favorites: 0.

Sub-skills: 0.

Aggregator: No.

ai-llm-inference | SkillHub