Data

Tools

Indexes

Applications

Experiments

Open Source Science

vae-sam

VAEs and SAM

https://github.com/rpatrik96/vae-sam

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: arxiv.org, zenodo.org
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (11.4%) to scientific vocabulary
Last synced: 7 months ago · JSON representation ·

Repository

VAEs and SAM

Basic Info
  • Host: GitHub
  • Owner: rpatrik96
  • License: apache-2.0
  • Language: Python
  • Default Branch: master
  • Size: 2.14 MB
Statistics
  • Stars: 3
  • Watchers: 3
  • Forks: 0
  • Open Issues: 0
  • Releases: 1
Created over 3 years ago · Last pushed over 2 years ago
Metadata Files
Readme License Citation

README.md

# SAMBA: Regularized Autoencoders perform Sharpness-Aware Minimization [![Conference](http://img.shields.io/badge/AABI-2023.svg)](https://openreview.net/forum?id=gk3PAmy_UNz) ![CI testing](https://github.com/rpatrik96/vae-sam/workflows/CI%20testing/badge.svg?branch=master&event=push)

Description

We design a deterministic Autoencoder (called SAMBA) and show that the (deterministic) Regularized Autoencoder from Ghosh et al., 2020 performs Sharpness-Aware Minimization (SAM).

How to run

First, install dependencies
```bash

clone vae-sam

git clone --recurse-submodules https://github.com/rpatrik96/vae-sam

if forgot to pull submodules, run

git submodule update --init

install vae-sam

cd vae-sam pip install -e .
pip install -r requirements.txt

install submodule requirements

pip install --requirement tests/requirements.txt --quiet

install pre-commit hooks (only necessary for development)

pre-commit install Next, navigate to the `vae-sam` directory and run `vae_sam/cli.py. bash python3 vaesam/cli.py fit --help python3 vaesam/cli.py fit --config configs/config.yaml ```

Hyperparameter optimization

First, you need to log into wandb bash wandb login #you will find your API key at https://wandb.ai/authorize

Then you can create and run the sweep bash wandb sweep sweeps/sam.yaml # returns sweep ID wandb agent <ID-comes-here> --count=<number of runs> # when used on a cluster, set it to one and start multiple processes

Citation

```

@inproceedings{ reizinger2023samba, title={{SAMBA}: Regularized Autoencoders perform Sharpness-Aware Minimization}, author={Patrik Reizinger and Ferenc Husz{\'a}r}, booktitle={Fifth Symposium on Advances in Approximate Bayesian Inference}, year={2023}, url={https://openreview.net/forum?id=gk3PAmy_UNz} }

```

Owner

  • Name: Patrik Reizinger
  • Login: rpatrik96
  • Kind: user
  • Location: Germany
  • Company: IMPRS-IS, ELLIS

PhD student at IMPRS-IS (University of Tübingen) and ELLIS. Looking into causality and representation learning.

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Reizinger"
  given-names: "Patrik"
  orcid: "https://orcid.org/0000-0001-9861-0293"
- family-names: "Huszár"
  given-names: "Ferenc"
  orcid: "https://orcid.org/0000-0002-4988-1430"
title: "vae-sam"
version: 1.0.0
doi:
date-released:
url: "https://github.com/rpatrik96/vae-sam"

GitHub Events

Total
Last Year

Committers

Last synced: 10 months ago

All Time
  • Total Commits: 178
  • Total Committers: 1
  • Avg Commits per committer: 178.0
  • Development Distribution Score (DDS): 0.0
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Patrik Reizinger p****7@g****m 178

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 5
  • Total pull requests: 33
  • Average time to close issues: 29 days
  • Average time to close pull requests: 10 minutes
  • Total issue authors: 1
  • Total pull request authors: 1
  • Average comments per issue: 0.8
  • Average comments per pull request: 0.06
  • Merged pull requests: 33
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • rpatrik96 (5)
Pull Request Authors
  • rpatrik96 (33)
Top Labels
Issue Labels
Pull Request Labels

Dependencies

.github/workflows/ci-testing.yml actions
  • actions/cache v3 composite
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
requirements.txt pypi
  • PyYAML *
  • hydra-core *
  • jsonargparse *
  • lightning-bolts *
  • matplotlib *
  • numpy *
  • omegaconf *
  • pandas *
  • pre-commit *
  • pytest *
  • pytorch-lightning *
  • setuptools *
  • torch *
  • torchmetrics *
  • torchvision *
  • tueplots *
  • wandb *
setup.py pypi
  • pytorch-lightning *
tests/requirements.txt pypi
  • black * test
  • check-manifest * test
  • codecov * test
  • coverage * test
  • flake8 * test
  • pytest * test
  • pytest-cov * test
  • pytest-flake8 * test