Skip to main content

Awesome LLM pre-training resources, including data, frameworks, and methods.

404
GitHub Stars
128
Curated Resources
4
Categories
1 hour ago
Last Refreshed
I. Technical ReportsII. Training StrategiesIII. Open-source DatasetsIV. Data Methods

Use this list with your AI agent

Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:

"Show me the best resources from awesome-llm-pretraining"

Installation instructions →