Skip to main content

Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). It covers datasets, tuning techniques, in-context learning, visual reasoning, foundational models, and more. Stay updated with the latest advancement.

377
GitHub Stars
438
Curated Resources
26
Categories
22 hours ago
Last Refreshed
Trending LLM ProjectsPractical Guides for Prompting (Helpful)High-quality generationDeep understandingRaising the length limit of TransformersCompressing memories with vectors or data structuresMemory retrievalMultimodal Instruction TuningMultimodal In-Context LearningMultimodal Chain-of-ThoughtLLM-Aided Visual ReasoningFoundation ModelsOthersTutorials about LLMOpen Source LLMLLM Training FrameworksTools for deploying LLMCourses about LLMDatasets of Multimodal Instruction TuningOther useful resourcesPrompting libraries & toolsDatasets of In-Context LearningDatasets of Multimodal Chain-of-ThoughtPretraining dataPractical Guide for NLP TasksRLHFdataset

Use this list with your AI agent

Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:

"Show me 2023 resources from awesome_multimodel_llm"

Installation instructions →

What's inside

Other useful resources

  • 500+ Best AI Tools

  • Arize-Phoenix

    Open-source tool for ML observability that runs in your notebook environment. Monitor and fine tune LLM, CV and Tabular Models.

  • AutoGPT

    an experimental open-source application showcasing the capabilities of the GPT-4 language model.

  • chatgpt-shroud

    A Chrome extension for OpenAI's ChatGPT, enhancing user privacy by enabling easy hiding and unhiding of chat history. Ideal for privacy during screen shares.

  • chatgpt-wrapper

    ChatGPT Wrapper is an open-source unofficial Python API and CLI that lets you interact with ChatGPT.

  • Cohere Summarize Beta

    Introducing Cohere Summarize Beta: A New Endpoint for Text Summarization

Tools for deploying LLM

  • Agenta

    Easily build, version, evaluate and deploy your LLM-powered apps.

  • Embedchain

    Framework to create ChatGPT like bots over your dataset.

  • FastChat

    A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

  • Haystack

    an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.

LLM Training Frameworks

  • Alpa

    Alpa is a system for training and serving large-scale neural networks.

  • BMTrain

    Efficient Training for Big Models.

  • Colossal-AI

    Making large AI models cheaper, faster, and more accessible.

  • DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  • FairScale

    FairScale is a PyTorch extension library for high performance and large scale training.

  • GPT-NeoX

    An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

Open Source LLM

  • Alpaca

    A model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations.

  • Aquila

    悟道·天鹰语言大模型是首个具备中英双语知识、支持商用许可协议、国内数据合规需求的开源语言大模型。

  • baichuan-7B

    baichuan-7B 是由百川智能开发的一个开源可商用的大规模预训练语言模型.

  • Baize

    Baize is an open-source chat model trained with

  • BayLing

    an English/Chinese LLM equipped with advanced language alignment, showing superior capability in English/Chinese generation, instruction following and multi-turn interaction.

  • BELLE

    Be Everyone's Large Language model Engine

Trending LLM Projects

  • anything-llm

    A private ChatGPT to chat with anything!

  • Devika

  • llm-course

    Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

  • ollama

    Get up and running with Llama 2 and other large language models locally.

Prompting libraries & tools

Showing a sample of 438 resources. View the full list on GitHub →