contrastive-vit
Science Score: 31.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (4.4%) to scientific vocabulary
Repository
Basic Info
- Host: GitHub
- Owner: gcascio
- Language: Python
- Default Branch: main
- Size: 28.3 KB
Statistics
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
Contrastive Self-Supervised Pretraining of Vison Transformers
This repo contains code used to perform contrastive self-supervised pretraining of a vision transformer (ViT) using the SimCLR framework as part of a bachelor thesis.
Acknowledgements
I want to thank the members of the machine learning chair of the Heinrich-Heine-Universität for their support during my bachelor thesis. I also want to thank Google Research and their support providing access to cloud TPUs from Google's TPU Research Cloud (TRC) program.
Citations
bibtex
@misc{dosovitskiy2020image,
title = {An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale},
author = {Alexey Dosovitskiy and Lucas Beyer and Alexander Kolesnikov and Dirk Weissenborn and Xiaohua Zhai and Thomas Unterthiner and Mostafa Dehghani and Matthias Minderer and Georg Heigold and Sylvain Gelly and Jakob Uszkoreit and Neil Houlsby},
year = {2020},
eprint = {2010.11929},
archivePrefix = {arXiv},
primaryClass = {cs.CV}
}
bibtex
@misc{chen2020simple,
title = {A Simple Framework for Contrastive Learning of Visual Representations},
author = {Ting Chen and Simon Kornblith and Mohammad Norouzi and Geoffrey Hinton},
year = {2020}
}
Owner
- Name: Giovanni Cascio
- Login: gcascio
- Kind: user
- Location: Germany
- Company: solyd
- Website: gcasc.io
- Repositories: 36
- Profile: https://github.com/gcascio
Tinkering @solydhq
Citation (CITATION.bib)
@software{cascio2021vit,
author = {Cascio, Giovanni},
month = {12},
title = {{Contrastive Self-Supervised Pretraining of Vison Transformers}},
url = {https://github.com/gcascio/contrastive-vit},
version = {0.0.1},
year = {2021}
}
GitHub Events
Total
Last Year
Committers
Last synced: about 1 year ago
Top Committers
| Name | Commits | |
|---|---|---|
| Giovanni Cascio | g****-@l****e | 3 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: about 1 year ago
All Time
- Total issues: 0
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 0
- Total pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0