fl-demonstrator-mnist
MNIST example client of the federated learning platform
Science Score: 75.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
✓DOI references
Found 2 DOI reference(s) in README -
✓Academic publication links
Links to: zenodo.org -
○Academic email domains
-
✓Institutional organization owner
Organization dlr-ki has institutional domain (www.dlr.de) -
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (16.3%) to scientific vocabulary
Repository
MNIST example client of the federated learning platform
Basic Info
- Host: GitHub
- Owner: DLR-KI
- Language: Shell
- Default Branch: main
- Homepage: https://dlr-ki.github.io/fl-demonstrator-mnist/
- Size: 300 KB
Statistics
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 2
Metadata Files
README.md
Federated Learning Demonstrator MNIST Example
This repository contains an example client of a Federated Learning platform. The example shows how to create a client which trains a model based on the popular MNIST dataset. This repository also include many scripts to show how to interact with the Federated Learning platform directly.
The code of this MNIST example is based on the example from PyTorch.
This project is a component of the Federated Learning (FL) platform, serving as a proof of concept for the Catena-X project. The FL platform aims to demonstrate the potential of federated learning in a practical, real-world context.
For a comprehensive understanding of the FL platform, please refer to the official FL platform documentation.
A complete list of all repositories relevant to the FL platform can be found here.
Get Started
The code of this repository is part of the MNIST example client tutorial for the Federated Learning platform. The MNIST client implementation is based on the provided Federated Learning platform client base package.
This README.md is primarily intended for developers and contributors, providing necessary information for setup, installation, and contribution guidelines. If you're interested in using or testing this project, we recommend starting with the GitHub pages. They offer a more user-friendly interface and comprehensive guides to get you started.
Requirements
- python 3.10 or later
which python - virtualenv or venv
pip install -U virtualenv - jq command for JSON parsing inside bash
sudo apt-get install jq
Install
```bash
create virtual environment
virtualenv -p $(which python3.10) .venv
or
python -m venv .venv
activate our virtual environment
source .venv/bin/activate
update pip (optional)
python -m pip install -U pip
install
./dev install -U -e ".[all]" ```
Helpers
```txt
$ ./dev --help
usage: ./dev
positional arguments: {clean,coverage,coverage-report,doc,doc-build,docker-build,help,install,licenses,licenses-check,lint,lint-code,lint-doc,lint-scripts,mypy,safety-check,start,test,version,versions} Available sub commands help Show this help message and exit start Run the application docker-build Build docker images for local development test Run all tests lint Run all linter lint-code Run code linter lint-doc Run documentation linter lint-scripts Run bash script linter mypy Run type checker coverage Run unit tests coverage-report Generate test coverage report doc Start documentation server doc-build Build documentation licenses Generate licenses licenses-check Check licenses safety-check Check dependencies for known security vulnerabilities install Install package clean Clean up local files version Show package version versions Show versions
options: --no-http-serve Do not serve the action result via HTTP ```
Contribution
- Type-Save and linting with mypy+flake8
- Scripts and examples for linux, wsl (bash)
Documentation
This projects is using the Docstring style from Google. At least public classes, methods, fields, ... should be documented.
```python """ This is the single line short description.
This is the multiline or long description. Note, that the whole Docstring support markdown styling.
The long description can also contains multiple paragraphs.
Args: logfilepath (str): Log file path. ensurelog_dir (bool, optional): Create directory for the log file if not exists. Defaults to True.
Returns: Dict[str, Any]: logging configuration dict """ ```
Credits
Owner
- Name: DLR Institute of AI Safety and Security
- Login: DLR-KI
- Kind: organization
- Website: https://www.dlr.de/en/ki
- Repositories: 1
- Profile: https://github.com/DLR-KI
Citation (CITATION.cff)
# SPDX-FileCopyrightText: 2024 Benedikt Franke <benedikt.franke@dlr.de>
# SPDX-FileCopyrightText: 2024 Florian Heinrich <florian.heinrich@dlr.de>
#
# SPDX-License-Identifier: Apache-2.0
# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!
cff-version: 1.2.0
title: DLR Federated Learning Logging Base
message: >-
If you use this software, please cite it using the
metadata from this file.
type: software
authors:
- given-names: Florian
family-names: Heinrich
email: florian.heinrich@dlr.de
affiliation: German Aerospace Center (DLR)
orcid: 'https://orcid.org/0009-0007-0792-7908'
- given-names: Benedikt
family-names: Franke
email: benedikt.franke@dlr.de
affiliation: German Aerospace Center (DLR)
orcid: 'https://orcid.org/0000-0003-0202-2804'
identifiers:
- type: doi
value: 10.5281/zenodo.13951225
repository-code: 'https://github.com/DLR-KI/fl-demonstrator-mnist'
url: 'https://dlr-ki.github.io/fl-demonstrator-mnist/'
keywords:
- Federaed Machine Learning
- Python
GitHub Events
Total
- Release event: 1
- Push event: 4
- Create event: 1
Last Year
- Release event: 1
- Push event: 4
- Create event: 1
Dependencies
- ghcr.io/dlr-ki/fl-demonstrator-client main build
- ghcr.io/dlr-ki/fl-demonstrator-server-celery main
- ghcr.io/dlr-ki/fl-demonstrator-server-django main
- postgres latest
- quay.io/minio/minio latest
- redis latest
- local/fl-demonstrator-client-mnist latest
- boto3 ~=1.28.2
- dlr-logging @ git+https://github.com/DLR-KI/fl-logging-base.git@main
- fl-demonstrator-client @ git+https://mnist-example:EEKvxrARr8gDGxx9r4oW@gitlab.dlr.de/ki-cx-federatedlearning/fl-demonstrator-client.git@main
- numpy ~=1.24.3
- tensorboard ~=2.13.0
- torch ~=2.0.1
- torcheval ~=0.0.6
- torchvision ~=0.15.2
- actions/checkout v4 composite
- actions/deploy-pages v3 composite
- actions/setup-node v4 composite
- actions/setup-python v5 composite
- actions/upload-pages-artifact v2 composite
- docker/build-push-action v5 composite
- docker/login-action v3 composite
- docker/metadata-action v5 composite