Data

Tools

Indexes

Applications

Experiments

Open Source Science

federated-learning

https://github.com/y1lichen/federated-learning

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (3.6%) to scientific vocabulary
Last synced: 6 months ago · JSON representation ·

Repository

Basic Info
  • Host: GitHub
  • Owner: y1lichen
  • Language: Python
  • Default Branch: main
  • Size: 18.5 MB
Statistics
  • Stars: 2
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created almost 2 years ago · Last pushed over 1 year ago
Metadata Files
Readme Citation

README.md

說明

程式碼是由llm-flowertune修改而來的。 修改的項目主要有： 1. 改用Taiwan-LLM 2. 調整訓練設定 3. 改用本地資料訓練

重寫custom dataset。面對flower這種api迭代快速的新framework，programmer最高指導原則為不動可以運作的程式碼。看不懂custom_dfs的code很正常，因為我也不懂。 4. 拆分client & server
在聯邦式學習中client和server勢必會分開部署，要降低client和server的藕合性。

  1. 設定為只需一個client即可進行federated learning

  2. 改使用.npz儲存訓練結果 註：用peft model儲存方法見base-FL分支

  3. 目前main分支取消使用GPU 有關GPU相關設定，見base-FL分支

操作說明

  1. 準備訓練資料 準備欄位為instruction, input, output, text的csv檔案。

  2. 啟動server python run server/run_server.py

  3. 啟動client

python client/run_client.py --i path/path_to_csv_data0.csv

Owner

  • Login: y1lichen
  • Kind: user

Citation (CITATION.cff) 

# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.0.0
title: "Personalization conversation LLM with federated learning"
message: >-
  If you use this software, it is welcome to cite it using the
  metadata from this file.
type: software
authors:
  - given-names: "I LI"
    family-names: "Chen"
    email: "f1jefferson2@gmail.com"
identifiers:
  - type: url
    value: "https://github.com/y1lichen/federated-learning"
repository-code: "https://github.com/y1lichen/federated-learning"
version: 1.0.0
date-released: 2024-06-04

GitHub Events

Total
Last Year

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 1
  • Total pull requests: 0
  • Average time to close issues: 5 days
  • Average time to close pull requests: N/A
  • Total issue authors: 1
  • Total pull request authors: 0
  • Average comments per issue: 0.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • y1lichen (1)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels

Dependencies

requirements.txt pypi
  • bitsandbytes ==0.41.3
  • flwr >=1.8.0,<2.0
  • flwr_datasets ==0.0.2
  • fschat ==0.2.35
  • hydra-core ==1.3.2
  • peft ==0.4.0
  • scipy ==1.11.2
  • transformers ==4.38.1
  • trl ==0.7.2