Skip to main content

Awesome series for LLMOps

55
GitHub Stars
51
Curated Resources
6
Categories
4 hours ago
Last Refreshed
Prompt EngineeringOptimizationTools (GitHub)Tools (Other)RLHFAwesome

Use this list with your AI agent

Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:

"Show me tools (github) resources from awesome-llmops"

Installation instructions →

What's inside

Tools (GitHub)

  • alpaca-lora

    Instruct-tune LLaMA on consumer hardware.

  • Auto-GPT

    An experimental open-source attempt to make GPT-4 fully autonomous.

  • bosquet

    LLMOps for Large Language Model based applications.

  • dalai

    The cli tool to run LLaMA on the local machine.

  • deeplake

    Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets.

  • DeepSpeed

    A deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Prompt Engineering

RLHF

  • evals

    A curated list of reinforcement learning with human feedback resources.

  • PaLM-rlhf-pytorch

    Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture.

  • trlx

    A repo for distributed training of language models with Reinforcement Learning via Human Feedback. (RLHF)

Tools (Other)

  • LangSmith

    A monitoring and debugging platform by the LangChain team that provides systematic performance tracking, error analysis, and logging for LLM-based applications.

  • OpenLLM (by BentoML)

    A deployment tool from BentoML that simplifies serving various large language models in production environments.

  • PaLM2 API

    An API service that makes PaLM2, Large Language Models (LLMs), available to Google Cloud Vertex AI.

  • Perspective API

    A tool that can help mitigate toxicity and ensure healthy dialogue online.

  • PromptLayer

    A tool for tracking and analyzing prompt engineering experiments, helping optimize prompt performance and outcomes.

Showing a sample of 51 resources. View the full list on GitHub →