multi-modal

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

ModelScope: bring the notion of Model-as-a-Service to life.

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

Start building LLM-empowered multi-agent applications in an easier way.

a state-of-the-art-level open visual language model | 多模态预训练模型

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai

Open Source Routing Engine for OpenStreetMap

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型

OmniGen: Unified Image Generation. https://arxiv.org/pdf/2409.11340

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Represent, send, store and search multimodal data

GPT4V-level open-source multi-modal model based on Llama3-8B

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Project Page for "LISA: Reasoning Segmentation via Large Language Model"