Skip to content

Shuffling in GAGA pretraining #23

Description

@RadoslavMYankov

Thank you for your amazing work! When going through your code after reading GAGA and MIOFlow I stubled upon a potential issue.

It seems like you only shuffle the indices once before training the distance preserving autoencoder and then keep fixed batches over the course of the training. Is this the desired behaviour and why would you prefer this over ranom samples in each iteration?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions