Repository navigation

vision-transformer

Website
Wikipedia

OpenMMLab Detection Toolbox and Benchmark

object-detection instance-segmentation fast-rcnn faster-rcnn mask-rcnn cascade-rcnn ssd retinanet PyTorch panoptic-segmentation rtmdet swin-transformer transformer vision-transformer yolo convnext detr grounding-dino

Python

31754

9752

1 年前

lukas-blecher / LaTeX-OCR

pix2tex: Using a ViT to convert images of equations into LaTeX code.

机器学习 transformer im2latex 深度学习 image2text LaTeX dataset PyTorch im2markup OCR latex-ocr vit math-ocr vision-transformer 图像处理 Python im2text

Python

15759

1254

9 个月前

NielsRogge / Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

transformers PyTorch bert vision-transformer layoutlm gpt-2

Jupyter Notebook

11261

1678

3 个月前

FoundationVision / VAR

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

auto-regressive-model diffusion-models image-generation transformers autoregressive-models generative-ai generative-model gpt gpt-2 large-language-models vision-transformer neurips

Jupyter Notebook

8417

543

5 个月前

adithya-s-k / omniparse

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

OCR omniparser parse-server parser-library vision-transformer web-crawler

Python

6698

526

4 个月前

JingyunLiang / SwinIR

SwinIR: Image Restoration Using Swin Transformer (official repository)

image-super-resolution image-denoising compression-artifact-reduction image-deblocking transformer real-world-image-super-resolution lightweight-image-super-resolution image-restoration low-level-vision vision-transformer restoration super-resolution denoising decompression

Python

5102

598

1 年前

cmhungsteve / Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

transformer attention-mechanism vision-transformer 深度学习 Awesome Lists transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer 机器视觉 papers attention-mechanisms self-attention vit detr transformers

4929

496

1 年前

huawei-noah / Efficient-AI-Backbones

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

convolutional-neural-networks efficient-inference imagenet model-compression Tensorflow PyTorch ghostnet transformer pretrained-models vision-transformer

Python

4312

733

7 个月前

open-mmlab / mmpretrain

OpenMMLab Pre-training Toolbox and Benchmark

image-classification resnet mobilenet PyTorch 深度学习 swin-transformer beit clip constrastive-learning convnext masked-image-modeling moco pretrained-models self-supervised-learning vision-transformer multimodal

Python

3752

1106

1 年前

google-research / scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

jax 机器视觉深度学习 research attention transformers vision-transformer

Python

3683

464

3 天前

towhee-io / towhee

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

机器学习 convolutional-networks embedding-vectors embeddings 机器视觉图像处理 video-processing feature-extraction image-retrieval unstructured-data feature-vector transformer milvus vision-transformer vit pipeline 大语言模型

Python

3426

264

1 年前

mit-han-lab / efficientvit

Efficient vision foundation models for high-resolution generation and perception.

high-resolution imagenet efficientvit segment-anything segmentation vision-transformer deep-compression-autoencoder efficient-diffusion-model

Python

3087

232

1 个月前

InternLM / InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

ChatGPT visual-language-learning multi-modality foundation gpt-4 instruction-tuning mllm multimodal vision-language-model language-model 大语言模型 large-vision-language-model vision-transformer gpt

Python

2895

177

4 个月前

baaivision / EVA

EVA Series: Visual Representation Fantasies from BAAI

foundation-models representation-learning vision-transformer

Python

2577

187

1 年前

OpenGVLab / InternVideo

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

foundation-models video-understanding vision-transformer action-recognition multimodal temporal-action-localization video-question-answering zero-shot-classification benchmark contrastive-learning self-supervised instruction-tuning video-clip

Python

2063

127

2 个月前

hila-chefer / Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

深度学习 vision-transformer bert-model bert explainability vit cvpr2021

Jupyter Notebook

1933

257

2 年前

alibaba / EasyCV

An all-in-one toolkit for computer vision

self-supervised-learning transformers classification 机器视觉 object-detection PyTorch vision-transformer

Python

1906

217

5 个月前

microsoft / Cream

This is a collection of our NAS and Vision Transformer work.

nas automl vision-transformer rpe vit-compression efficiency knowledge-distillation

Python

1806

237

1 年前

NVlabs / MambaVision

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

深度学习 foundation-models image-classification mamba self-attention vision-transformer visual-recognition huggingface-transformers transformers instance-segmentation object-detection semantic-segmentation

Python

1771

100

2 个月前

ViTAE-Transformer / ViTPose

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

深度学习 distillation pose-estimation PyTorch self-supervised-learning vision-transformer

Python

1758

222

10 天前