Repository navigation

#

multimodal-generation

Website
Wikipedia

eric-ai-lab / MiniGPT-5

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

diffusion-models multimodal-generation transformers

Python

864

52

4 个月前

YingqingHe / Awesome-LLMs-meet-Multimodal-Generation

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

aigc large-language-models large-vision-language-models multimodal-generation multimodal-large-language-models multimodal-models multimodality text-to-3d text-to-audio text-to-image text-to-speech text-to-video 大语言模型 mllm

HTML

459

26

16 天前

chuhaojin / Text2Poster-ICASSP-22

Official implementation of the ICASSP-2022 paper "Text2Poster: Laying Out Stylized Texts on Retrieved Images"

aigc 深度学习 multimodal-generation 图像处理 image-retrieval artificial-neural-networks PyTorch object-detection image-text-retrieval

Python

211

18

1 年前

YangLing0818 / ContextDiff

[ICLR 2024] Contextualized Diffusion Models for Text-Guided Image and Video Generation

diffusion-models text-to-image-generation text-to-video multimodal-generation

Python

67

4

1 年前

Gen-Verse / HermesFlow

HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation

multimodal-large-language-models image-to-text multimodal-generation text-to-image

Python

55

3

2 个月前

wzk1015 / Awesome-Vision-to-Music-Generation

A curated list of vision-to-music generation: methods, datasets, evaluation and challenges.

music-generation survey multimodal-generation

53

1

6 天前

Nithin-GK / UniteandConquer

[CVPR '23] Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models

diffusion-models face-generation imagenet multimodal multimodal-deep-learning text-to-image multimodal-generation plug-and-play text-to-image-diffusion text-to-image-generation text-to-image-synthesis semantic-segmentation

Python

36

3

1 年前

PanguIR / MRAGSurvey

A Survey of Multimodal Retrieval-Augmented Generation

large-language-models llms multimodal-generation multimodal-large-language-models

13

1

3 天前