awesome-llmops
github.com/inftyai/awesome-llmops ↗🎉 An awesome & curated list of best LLMOps tools.
254
GitHub Stars
204
Curated Resources
4
Categories
19 hours ago
Last Refreshed
InferenceOrchestrationRuntimeTraining
Use this list with your AI agent
Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:
"Show me chatbot resources from awesome-llmops"
Installation instructions →What's inside
Runtime
- 5ireChatbot
- AgentEvolverEvolve Agent
- aiderAI Terminal
- AnythingLLMChatbot
- BeadsTool
A memory upgrade for your coding agent
- Browser UseTool
Training
- AgentBenchBenchmark
- AReaLAgentic RL
- ASQI EngineerBenchmark
run containerised AI tests and map to score cards!
- AXLearnFramework
- AxolotlFineTune
- CandleFramework
Orchestration
- Agent Development Kit (ADK)Agent Framework
- AgentFieldAgent Framework
scalable, observable, and identity-aware from day one.
- AgentMarkApplication Framework
- Agent Shadow BrainAgent Framework
- AgnoAgent Framework
- AIDE MLEvolutionary Framework
Inference
- agentgatewayAI Gateway
- AIBrixInference Platform
- AI GatewayLLM Router
- APISIXAI Gateway
- BAMLOutput
- BentoMLInference Platform
Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Showing a sample of 204 resources. View the full list on GitHub →