multimodal-generation

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

Official implementation of the ICASSP-2022 paper "Text2Poster: Laying Out Stylized Texts on Retrieved Images"

[ISMIR 2025] A curated list of vision-to-music generation: methods, datasets, evaluation and challenges.

[ICLR 2024] Contextualized Diffusion Models for Text-Guided Image and Video Generation

HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation

[CVPR '23] Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models

A Survey of Multimodal Retrieval-Augmented Generation

The code used to train and run inference with MMDocRAG