Skip to content

issues Search Results · repo:lucidrains/vit-pytorch language:Python

Filter by

270 results
 (50 ms)

270 results

inlucidrains/vit-pytorch (press backspace or delete to remove)

lucidrains/vit-pytorch
How to train？

Hello, thank you very much for your work. I am eager to know how to train a ViT model from scratch on the ImageNet dataset. I haven’t seen the Python file for training. Thank you!
  • LiJichen0114
  • 2
  • Opened 
    on Jan 7
  • #340

lucidrains/vit-pytorch
How can I use a 1D Vision Transformer?

I want to input sensor data, such as current measurements, and use the 1D Vision Transformer to predict future current trends.
  • SmallPotato705
  • 1
  • Opened 
    on Dec 24, 2024
  • #337

lucidrains/vit-pytorch
Allow to use classification token in CvT?

Thanks for the amazing collection of ViT implementations! As far as I see from the CvT paper, it also allows for a class token (like in ViT but which was removed in SimpleViT by the authors of the SimpleViT ...
  • Yash-10
  • Opened 
    on Nov 21, 2024
  • #336

lucidrains/vit-pytorch
Why not always project out from Attention block?

Hey, why is the out projection from the Attention block optional? See: https://github.com/lucidrains/vit-pytorch/blob/d47c57e32feae5c5a741a7d3baba3ac70cdb3567/vit_pytorch/vit.py#L33 - In the original ...
  • fiskrt
  • 1
  • Opened 
    on Nov 19, 2024
  • #335

lucidrains/vit-pytorch
train navit nest 3d error when backward

Thanks for your awesome work! When I try to train navit_nest_3d model, an error occured: Function UnbindBackwardAutogradNestedTensor0 returned an invalid gradient at index 0 - got 1 1024 1 1024 1 1024 ...
  • HaloTrouvaille
  • 5
  • Opened 
    on Nov 7, 2024
  • #332

lucidrains/vit-pytorch
RegionViT - Local token embedding

Hi, I believe there is an error here. In LayerNorm, the dimension of LayerNorm should either be the number of channels C (which requires change the input to a channel-last format), or it should be [C, ...
  • minhquoc0712
  • 1
  • Opened 
    on Oct 4, 2024
  • #330

lucidrains/vit-pytorch
The Total params: and Params size (MB) of the model printed by summary are different from the bit_base model in timm library. Theoretically, the same settings should be the same. What is the reason?

import torch from vit import ViT from torchsummary import summary import timm v = ViT( image_size = 224, patch_size = 16, num_classes = 1000, dim = 768, depth = 12, heads = 12, mlp_dim = 3072, dropout ...
  • lucker26
  • 1
  • Opened 
    on Sep 26, 2024
  • #329

lucidrains/vit-pytorch
MS-COCO training from Imagenet pretrained checkpoint

Hi, I would like to run a model for MS-COCO training from an imagenet pretrained checkpoint. Kindly advise how to do so
  • prateekiiest
  • 1
  • Opened 
    on Sep 20, 2024
  • #328

lucidrains/vit-pytorch
Multi-GPU training of NaViT model

Hello! I have a question about multi-GPU training using NaViT model. I am able to run the training on 1 GPU, but not on several. Any suggestions or ideas how it s possible to use multiple GPUs for training ...
  • b5y
  • 1
  • Opened 
    on Jul 4, 2024
  • #322

lucidrains/vit-pytorch
Weight Initialization

I m not sure if what I am saying is correct, but I do not see a place where we re initializing weights in the 3DViT model. I ve been experimenting it for 2 days and noticed that the model is not learning ...
  • simonaay
  • Opened 
    on Jul 3, 2024
  • #321
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue search results · GitHub