awesome-llm

List of AI Tools and Agents for Developers

an experimental open-source application showcasing the capabilities of the GPT-4 language model.

A Chrome extension for OpenAI's ChatGPT, enhancing user privacy by enabling easy hiding and unhiding of chat history. Ideal for privacy during screen shares.

ChatGPT Wrapper is an open-source unofficial Python API and CLI that lets you interact with ChatGPT.

Introducing Cohere Summarize Beta: A New Endpoint for Text Summarization

an evaluation benchmark focused on ancient Chinese language comprehension.

An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite.

A pioneering benchmark specifically designed to assess honesty in LLMs comprehensively.

evaluates LLM's ability to call external functions/tools.

a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner.

an expert-driven benchmark for Chineses LLMs.

AdalFlow: The library to build&auto-optimize LLM applications.

Easily build, version, evaluate and deploy your LLM-powered apps.

Open-source CLI security scanner for agentic workflows. Scans your workflow’s source code, detects vulnerabilities, and generates an interactive visualization along with a detailed security report. Supports LangGraph, CrewAI, n8n, OpenAI Agents, and more.

Open-source tool for ML observability that runs in your notebook environment. Monitor and fine tune LLM, CV and Tabular Models.

high quality and educational materials you don't want to miss.

My favorite!

Large Language Models

A collection of papers and resources about aligning large language models (LLMs) with human.

Curated list of resources for ChatGPT and GPT-3 from OpenAI.

A collection of prompt examples to be used with the ChatGPT model.

A Chinese collection of prompt examples to be used with the ChatGPT model.

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

An awesome and curated list of best code-LLM for research.

Open-source framework for fine-tuning and evaluating LLMs. It simplifies the process of experimenting with different training configurations and makes it easy to reproduce and share results, supporting features like LoRA, QLoRA, DeepSpeed, PEFT, and multi-GPU setups.

Efficient Training for Big Models.

Making large AI models cheaper, faster, and more accessible.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.