Skip to main content

Awesome LLM compression research papers and tools.

1.9k
GitHub Stars
1.2k
Curated Resources
2
Categories
2 hours ago
Last Refreshed
PapersTools

Use this list with your AI agent

Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:

"Show me inference and serving engines resources from awesome-llm-compression"

Installation instructions →

What's inside

Tools

  • [Code]Inference and Serving Engines

  • [Code]Inference and Serving Engines

  • [Code]Other Tools

  • [Code]Inference and Serving Engines

  • [Code]Quantization Libraries and Kernels

  • [Code]Inference and Serving Engines

Papers

Showing a sample of 1.2k resources. View the full list on GitHub →