awesome-local-ai
github.com/menloresearch/awesome-local-ai ↗An awesome repository of local AI tools
Use this list with your AI agent
Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:
"Show me agents resources from awesome-local-ai"
Installation instructions →What's inside
Agents
- AgentGPT
- AgentRunner.ai
Leverage the power of GPT-4 to create and train fully autonomous AI agents.
- AI Agents
AI Agent that Power Up Your Productivity.
- Auto-GPT
An experimental open-source attempt to make GPT-4 fully autonomous.
- BabyAGI
Baby AGI is an autonomous AI agent developed using Python that operates through OpenAI and Pinecone APIs.
- CrewAI
Cutting-edge framework for orchestrating role-playing, autonomous AI agents.
Inference UI
- AI-Mask
Browser extension to provide model inference to web apps. Backed by web-llm and transformers.js
- Automatic1111
Stable Diffusion web UI.
- ChatUI
Open source codebase powering the HuggingChat app.
- ComfyUI
A powerful and modular stable diffusion GUI with a graph/nodes interface.
- everything-rag
Interact with (virtually) any LLM on Hugging Face Hub with an asy-to-use, 100% local Gradio chatbot.
- faradav
Chat with AI Characters Offline, Runs locally, Zero-configuration.
Training
- Alpa
Alpa is a system for training and serving large-scale neural networks.
- BMTrain
Efficient Training for Big Models.
- DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
- FastChat
An open platform for training, serving, and evaluating large language models.
- Ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models.
- Megatron-LM
Ongoing research training transformer models at scale.
LLM Leaderboard
- AlpacaEval Leaderboard
An Automatic Evaluator for Instruction-following Language Models.
- Chatbot Arena Leaderboard
a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner.
- LLM-Leaderboard-streamlit
A joint community effort to create one central leaderboard for LLMs.
- lmsys.org
Benchmarking LLMs in the Wild with Elo Ratings.
- Open LLM Leaderboard
aims to track, rank and evaluate LLMs and chatbots as they are released.
Lists
- awesome-local-llms
Table of open-source local LLM inference projects with their GitHub metrics.
- llama-police
A list of Open Source LLM Tools from
Platforms / full solutions
Developer tools
- BentoML
BentoML is the platform for software engineers to build AI products.
- code-collator
- Datature
The All-in-One Platform to Build and Deploy Vision AI.
- GitFluence
The AI-driven solution that helps you quickly find the right command. Get started with Git Command Generator today and save time.
- Gooey.AI
Create Your Own No Code AI Workflows.
- gpt4all
A chatbot trained on a massive collection of clean assistant data including code, stories and dialogue.
Showing a sample of 114 resources. View the full list on GitHub →