Skip to content

Evaluation results #1

Description

@ed-fish

Hi,

Thanks for your work making a Pytorch version of the paper - much appreciated!

How does this implementation compare to results in the original paper. Specifically on the Moments in Time dataset.

Thanks,

Ed

Activity

  1. marco-hmc commented on May 28, 2021

    @marco-hmc

    I am also interested at this topic.
    If there is anyone could provide me more information about the model parameters that might help me fix the problem, I would be thankful for that because using the default parameters is always overfitting.

    Thanks.
    Marco

  2. Linwei94 commented on May 30, 2021

    @Linwei94

    I run the model on a very small dataset(51 classes with 20 video clips per class) and the result is very strange. Always output the same prediction. I wonder if it can be better if I load the pre-trained weights. I would appreciate anyone who can give me some tips.

    Thanks,
    Dylan

  3. marco-hmc commented on May 30, 2021

    @marco-hmc

    I run the model on a very small dataset(51 classes with 20 video clips per class) and the result is very strange. Always output the same prediction. I wonder if it can be better if I load the pre-trained weights. I would appreciate anyone who can give me some tips.

    Thanks,
    Dylan

    I am facing with the same situation with you. I still don't have any ideat about that now. Waiting for the reply for authors.

  4. Linwei94 commented on May 30, 2021

    @Linwei94

    I run the model on a very small dataset(51 classes with 20 video clips per class) and the result is very strange. Always output the same prediction. I wonder if it can be better if I load the pre-trained weights. I would appreciate anyone who can give me some tips.
    Thanks,
    Dylan

    I am facing with the same situation with you. I still don't have any ideat about that now. Waiting for the reply for authors.

    I wonder whether the problem results from the code or from my too-small dataset.

  5. vaibhavsah commented on Aug 9, 2021

    @vaibhavsah

    I tried it with a nearly 2000 Videos. Run different Epochs. But still the accuracy is not more than 21.09%. Strange thing is that it's same for most of the runs. No change in figures.

  6. Linwei94 commented on Aug 10, 2021

    @Linwei94

    I tried it with a nearly 2000 Videos. Run different Epochs. But still the accuracy is not more than 21.09%. Strange thing is that it's same for most of the runs. No change in figures.

    Your dataset is too small. You can try run ViViT with ViT’s weight loaded for both temporal and spatial part.

  7. vaibhavsah commented on Aug 11, 2021

    @vaibhavsah

    @DylanTao94 Can you share how I can do that.

  8. Linwei94 commented on Aug 11, 2021

    @Linwei94

    Sry mate, my code is not allowed to share. You can follow the steps in ViViT paper.

  9. seandatasci commented on Aug 14, 2021

    @seandatasci

    yes this model works fine i've tested it on a dataset of 50k videos

  10. vaibhavsah commented on Aug 15, 2021

    @vaibhavsah

    @seandatasci i think I might be doing something wrong with the code. Can you help me out here. My code is here

  11. Mark-Dou commented on Aug 25, 2021

    @Mark-Dou

    @seandatasci i think I might be doing something wrong with the code. Can you help me out here. My code is here

    i have the same problems with you, and i wonder you have resolved the problems whether or not, the acc or auc results is lower than 50%, the dataset size is also 2000, Thank u

  12. mx-mark commented on Dec 11, 2021

    @mx-mark

    Inspired from the implementation of the ViViT by the author, we have reimplement the TimeSformer and ViViT, and release the pretrain-model weights on Kinetics600 can be found here

  13. mnauf commented on Jun 8, 2023

    @mnauf

    The model isn't learning. Trained on 2 classes of UCF101 dataset. Adam optimizer, CrossEntropyLoss

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions