https://github.com/aidotse/next-word-fedn

https://github.com/aidotse/next-word-fedn

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (5.6%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: aidotse
  • Language: Jupyter Notebook
  • Default Branch: main
  • Size: 877 MB
Statistics
  • Stars: 0
  • Watchers: 3
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created over 1 year ago · Last pushed over 1 year ago
Metadata Files
Readme

README.md

Federated Learning for Next-Word Prediction

By AI Sweden Young Talents: Vsters.

Navigating this codebase

You can find the training notebook for our final model in ./train

The client code for federated learning is in the ./client

You can find old files and old models in the ./old

We also kept the data in git and is located in ./data

Intro

This project we took in collaboration with Scalout.

We were assigned to use their platform for federated learning and select a relevant industry + usecase to make the project in.

The industry we choosed was Mobile devices and the use case was next-word prediction.

A measurable goal we chose was to make it learn a new word.

Outcome

The final product is a foundation model, web-UI, and a fedn project that works with scaleout.

When presenting this project we managed to train it on hard-coded data from Scaleout's documentation.

After the model had trained in a client and aggregated through Scaleout's platform, we could see a notable difference in how it could predict words related to federated learning.

Before

federated-before

After

federated-after

Owner

  • Name: AI Sweden
  • Login: aidotse
  • Kind: organization
  • Email: info@ai.se
  • Location: Sweden

AI Sweden is a national center for applied AI research and innovation, with the aim to strengthen the competitiveness of the Swedish industry

GitHub Events

Total
  • Member event: 2
  • Push event: 2
  • Create event: 2
Last Year
  • Member event: 2
  • Push event: 2
  • Create event: 2

Dependencies

client/svelte/package-lock.json npm
  • 253 dependencies
client/svelte/package.json npm
  • @sveltejs/adapter-auto ^3.0.0 development
  • @sveltejs/adapter-node ^5.2.8 development
  • @sveltejs/kit ^2.0.0 development
  • @sveltejs/package ^2.0.0 development
  • @sveltejs/vite-plugin-svelte ^3.0.0 development
  • autoprefixer ^10.4.20 development
  • bits-ui ^0.21.16 development
  • clsx ^2.1.1 development
  • postcss ^8.4.47 development
  • prettier ^3.1.1 development
  • prettier-plugin-svelte ^3.1.2 development
  • publint ^0.2.0 development
  • svelte ^4.2.7 development
  • svelte-check ^4.0.0 development
  • tailwind-merge ^2.5.4 development
  • tailwind-variants ^0.2.1 development
  • tailwindcss ^3.4.14 development
  • typescript ^5.0.0 development
  • vite ^5.0.11 development
  • lucide-svelte ^0.453.0
  • mode-watcher ^0.4.1