Skip to main content

Awesome series for LLMOps

56
GitHub Stars
51
Curated Resources
6
Categories
14 min ago
Last Refreshed
Prompt EngineeringOptimizationTools (GitHub)Tools (Other)RLHFAwesome

Use this list with your AI agent

Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:

"Show me tools (github) resources from awesome-llmops"

Installation instructions →

What's inside

Tools (GitHub)

  • alpaca-lora

    Instruct-tune LLaMA on consumer hardware.

  • Auto-GPT

    An experimental open-source attempt to make GPT-4 fully autonomous.

  • bosquet

    LLMOps for Large Language Model based applications.

  • dalai

    The cli tool to run LLaMA on the local machine.

  • deeplake

    Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets.

  • DeepSpeed

    A deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Prompt Engineering

RLHF

  • evals

    A curated list of reinforcement learning with human feedback resources.

  • PaLM-rlhf-pytorch

    Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture.

  • trlx

    A repo for distributed training of language models with Reinforcement Learning via Human Feedback. (RLHF)

Tools (Other)

  • LangSmith

    A monitoring and debugging platform by the LangChain team that provides systematic performance tracking, error analysis, and logging for LLM-based applications.

  • OpenLLM (by BentoML)

    A deployment tool from BentoML that simplifies serving various large language models in production environments.

  • PaLM2 API

    An API service that makes PaLM2, Large Language Models (LLMs), available to Google Cloud Vertex AI.

  • Perspective API

    A tool that can help mitigate toxicity and ensure healthy dialogue online.

  • PromptLayer

    A tool for tracking and analyzing prompt engineering experiments, helping optimize prompt performance and outcomes.

Showing a sample of 51 resources. View the full list on GitHub →