Skip to main content

Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). It covers datasets, tuning techniques, in-context learning, visual reasoning, foundational models, and more. Stay updated with the latest advancement.

373
GitHub Stars
436
Curated Resources
26
Categories
3 hours ago
Last Refreshed
Trending LLM ProjectsPractical Guides for Prompting (Helpful)High-quality generationDeep understandingRaising the length limit of TransformersCompressing memories with vectors or data structuresMemory retrievalMultimodal Instruction TuningMultimodal In-Context LearningMultimodal Chain-of-ThoughtLLM-Aided Visual ReasoningFoundation ModelsOthersTutorials about LLMOpen Source LLMLLM Training FrameworksTools for deploying LLMCourses about LLMDatasets of Multimodal Instruction TuningOther useful resourcesPrompting libraries & toolsDatasets of In-Context LearningDatasets of Multimodal Chain-of-ThoughtPretraining dataPractical Guide for NLP TasksRLHFdataset

Use this list with your AI agent

Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:

"Show me 2023 resources from awesome_multimodel_llm"

Installation instructions →

What's inside

Other useful resources

  • 500+ Best AI Tools

  • Arize-Phoenix

    Open-source tool for ML observability that runs in your notebook environment. Monitor and fine tune LLM, CV and Tabular Models.

  • AutoGPT

    an experimental open-source application showcasing the capabilities of the GPT-4 language model.

  • chatgpt-shroud

    A Chrome extension for OpenAI's ChatGPT, enhancing user privacy by enabling easy hiding and unhiding of chat history. Ideal for privacy during screen shares.

  • chatgpt-wrapper

    ChatGPT Wrapper is an open-source unofficial Python API and CLI that lets you interact with ChatGPT.

  • Cohere Summarize Beta

    Introducing Cohere Summarize Beta: A New Endpoint for Text Summarization

Tools for deploying LLM

  • Agenta

    Easily build, version, evaluate and deploy your LLM-powered apps.

  • Embedchain

    Framework to create ChatGPT like bots over your dataset.

  • FastChat

    A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

  • Haystack

    an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.

LLM Training Frameworks

  • Alpa

    Alpa is a system for training and serving large-scale neural networks.

  • BMTrain

    Efficient Training for Big Models.

  • Colossal-AI

    Making large AI models cheaper, faster, and more accessible.

  • DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  • FairScale

    FairScale is a PyTorch extension library for high performance and large scale training.

  • GPT-NeoX

    An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

Open Source LLM

  • Alpaca

    A model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations.

  • Aquila

    悟道·天鹰语言大模型是首个具备中英双语知识、支持商用许可协议、国内数据合规需求的开源语言大模型。

  • baichuan-7B

    baichuan-7B 是由百川智能开发的一个开源可商用的大规模预训练语言模型.

  • Baize

    Baize is an open-source chat model trained with

  • BayLing

    an English/Chinese LLM equipped with advanced language alignment, showing superior capability in English/Chinese generation, instruction following and multi-turn interaction.

  • BELLE

    Be Everyone's Large Language model Engine

Trending LLM Projects

  • anything-llm

    A private ChatGPT to chat with anything!

  • Devika

  • llm-course

    Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

  • ollama

    Get up and running with Llama 2 and other large language models locally.

Prompting libraries & tools

Showing a sample of 436 resources. View the full list on GitHub →