gpt4v

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

Control Any Computer Using LLMs.

Vision utilities for web interaction agents 👀

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

Lightweight GPT-4 Vision processing over the Webcam

Prompts of GPT-4V & DALL-E3 to full utilize the multi-modal ability. GPT4V Prompts, DALL-E3 Prompts.

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

Draw your projects to life

Convert different model APIs into the OpenAI API format out of the box.

GPT-4V in Wonderland: LMMs as Smartphone Agents

Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

The ultimate sketch to code app made using GPT4o serving 25k+ users. Choose your desired framework (React, Next, React Native, Flutter) for your app. It will instantly generate code and preview (sandbox) from a simple hand drawn sketch on paper captured from webcam

Early Alpha Release: Chat with Your Image - Leveraging GPT-4 Vision and Function Calls for AI-Powered Image Analysis and Description

Mark web pages for use with vision-language models

Monitor the performance of OpenAI's GPT O3 Mini model over time.

Video Voiceover with gpt-4o-mini

This repository offers a Python framework for a retrieval-augmented generation (RAG) pipeline using text and images from MHTML documents, leveraging Azure AI and OpenAI services. It includes ingestion and enrichment flows, a RAG with Vision pipeline, and evaluation tools.

Language instructions to mycobot using GPT-4V