awesome-llmops
github.com/inftyai/awesome-llmops ↗🎉 An awesome & curated list of best LLMOps tools.
259
GitHub Stars
226
Curated Resources
4
Categories
11 hours ago
Last Refreshed
InferenceOrchestrationRuntimeTraining
Use this list with your AI agent
Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:
"Show me chatbot resources from awesome-llmops"
Installation instructions →What's inside
Runtime
- 5ireChatbot
- AgentEvolverEvolve Agent
- Agent QAAI Agent
- Agent-Ready Repository AuditorTool
- aiderAI Terminal
- AnythingLLMChatbot
Training
- AgentBenchBenchmark
- AReaLAgentic RL
- ASQI EngineerBenchmark
run containerised AI tests and map to score cards!
- AXLearnFramework
- AxolotlFineTune
- CandleFramework
Orchestration
- Agent Development Kit (ADK)Agent Framework
- AgentFieldAgent Framework
scalable, observable, and identity-aware from day one.
- AgentMarkApplication Framework
- Agent Shadow BrainAgent Framework
- AgnoAgent Framework
- AIDE MLEvolutionary Framework
Inference
- agentgatewayAI Gateway
- AIBrixInference Platform
- AI GatewayLLM Router
- APISIXAI Gateway
- BAMLOutput
- BentoMLInference Platform
Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Showing a sample of 226 resources. View the full list on GitHub →